-- Logs begin at Fri 2022-05-13 12:28:03 UTC, end at Fri 2022-05-13 13:44:10 UTC. -- May 13 13:13:38.946217 dv-cinder-841632-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 13 13:13:38.955393 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 13 13:13:38.957916 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 13 13:13:38 2022] *** May 13 13:13:38.957916 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 13 13:13:38.957916 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 13 13:13:38.957916 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: nodename: dv-cinder-841632-1-iscsi May 13 13:13:38.957916 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: machine: x86_64 May 13 13:13:38.957916 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: clock source: unix May 13 13:13:38.957916 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: pcre jit disabled May 13 13:13:38.957916 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: detected number of CPU cores: 4 May 13 13:13:38.957916 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: current working directory: / May 13 13:13:38.957916 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: detected binary path: /usr/bin/uwsgi-core May 13 13:13:38.957916 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: your processes number limit is 47680 May 13 13:13:38.957916 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: your memory page size is 4096 bytes May 13 13:13:38.957916 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: detected max file descriptor number: 2048 May 13 13:13:38.957916 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: lock engine: pthread robust mutexes May 13 13:13:38.958992 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: thunder lock: enabled May 13 13:13:38.958992 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 13 13:13:38.958992 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 13 13:13:39.004704 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: Python main interpreter initialized at 0x5641d59899c0 May 13 13:13:39.004704 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: python threads support enabled May 13 13:13:39.004704 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: your server socket listen backlog is limited to 100 connections May 13 13:13:39.004704 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: your mercy for graceful operations on workers is 90 seconds May 13 13:13:39.005115 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: mapped 403077 bytes (393 KB) for 2 cores May 13 13:13:39.005115 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: *** Operational MODE: preforking *** May 13 13:13:39.005393 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: *** uWSGI is running in multiple interpreter mode *** May 13 13:13:39.005393 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: spawned uWSGI master process (pid: 103313) May 13 13:13:39.005623 dv-cinder-841632-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 13 13:13:39.006221 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: spawned uWSGI worker 1 (pid: 103314, cores: 1) May 13 13:13:39.006577 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: spawned uWSGI worker 2 (pid: 103315, cores: 1) May 13 13:13:39.006716 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 13 13:13:40.232673 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 13:13:40.233441 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 13:13:40.973041 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:13:40.973041 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: from cryptography.utils import int_from_bytes May 13 13:13:40.973377 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:13:40.973377 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: from cryptography.utils import int_from_bytes May 13 13:13:40.980899 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:13:40.980899 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: from cryptography.utils import int_from_bytes May 13 13:13:40.981234 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:13:40.981234 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: from cryptography.utils import int_from_bytes May 13 13:13:43.652236 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 13:13:43.652797 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 13:13:43.652886 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 13:13:43.653226 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 13:13:43.653308 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 13:13:43.653376 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 13:13:43.653589 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 13:13:43.653681 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 13:13:43.653957 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 13:13:43.654095 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.654231 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 13:13:43.654335 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.654608 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.654709 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.654926 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.655030 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.655243 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.655337 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.655553 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.655653 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.655872 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.655967 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.656179 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.656265 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.656498 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.656583 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.656759 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.656859 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.657073 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.657226 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.657398 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841632-1-iscsi {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.657487 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.657720 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.657817 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.658025 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.658122 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841632-1-iscsi {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.658355 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.658445 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.658673 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.658759 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.658977 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.659081 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.659452 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.659592 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.659797 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.659894 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.660132 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.660327 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.660433 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.660767 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.660933 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.661154 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.661320 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.661470 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.661640 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.661756 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.661870 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.661983 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.662127 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.662315 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.662476 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.662636 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.662768 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.662942 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.663088 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.663268 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.663394 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.663579 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.663715 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.663977 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841632-1-iscsi {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.664106 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.664294 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.664431 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841632-1-iscsi {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.664605 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.664692 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.664917 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.665005 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.665290 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.665376 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.665630 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.665719 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.665940 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.666031 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.666286 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.666419 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.666613 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.666745 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.666920 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.667011 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.667226 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.667363 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.667551 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.667646 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.667868 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.667957 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.668185 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.668273 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.668486 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.668585 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.668788 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.668874 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.669093 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.669179 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.669401 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.669498 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.669705 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.669800 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.670010 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.670097 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.670279 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.670391 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.670580 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.670667 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.670885 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.670980 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.671204 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.671323 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.671526 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.671645 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.671777 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.671966 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.672071 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.672218 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.672321 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.672468 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.672632 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.672785 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.672938 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.673103 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.673244 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.673408 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.673548 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.673712 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.673856 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.674015 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.674141 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.674677 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.674879 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.674977 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.675164 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.675271 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.675521 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.675610 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.675929 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.676088 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.676227 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.676312 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.676553 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.676652 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.676872 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.676974 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.677378 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.677511 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.677627 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.677741 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.677845 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.677927 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.678187 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.678408 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.678525 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.678675 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.678828 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.678971 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.679147 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.679290 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.679474 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.679610 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.679781 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.679922 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.680085 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.680238 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.680392 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.680558 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.680710 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.680864 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.681031 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.681168 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.681334 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.681474 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.681571 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.681790 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.681878 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.682111 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.682277 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.682440 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.682531 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.682693 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.682780 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.682994 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.683096 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.683298 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.683386 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.683615 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.683702 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.683920 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.684016 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.684224 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.684318 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.684526 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.684613 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.684822 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.684921 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.685125 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.685211 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.685424 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.685523 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.685726 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.685821 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.686028 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.686120 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.686351 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.686441 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.686655 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.686743 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.686959 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.687055 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.687261 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.687348 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.687560 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.687656 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.687862 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.687964 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.688165 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.688254 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.688473 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.688567 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.688775 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.688861 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.689076 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.689175 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.689378 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.689474 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.689696 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.689788 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.689998 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.690084 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.690327 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.690908 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.691170 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.691426 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.691569 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.691736 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.691890 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.692042 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.692193 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.692361 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.692500 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.692669 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.692818 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.692974 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.693125 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.693294 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.693430 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.693743 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.693945 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.694058 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.694932 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.695088 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.695088 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.695351 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.695436 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.695516 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.695595 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.695595 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.695727 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.695815 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.696062 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.696151 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.696377 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.696530 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.696680 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.696980 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.697068 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.697300 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.697504 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.697622 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.697933 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.698034 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.698268 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.698540 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.698641 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.698881 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.698989 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.699220 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.699310 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:13:43.699805 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.699893 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.700153 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.700247 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.700467 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.700554 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.700799 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.700898 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.701130 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.701234 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.701446 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.701535 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.701758 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.701846 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.702071 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.702167 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.702421 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.702510 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.702733 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.702821 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.703044 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.703133 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.703353 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.703447 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.703665 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.703757 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.703981 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.704068 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.704300 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.704396 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.704612 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.704705 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.704927 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.705023 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.705282 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.705377 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.705563 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.705659 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.705875 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.705973 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.706882 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.707003 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.707212 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.707289 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.707525 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.707613 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.707862 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.707950 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.708206 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.708320 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.708517 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.708607 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.708840 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.708928 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.709161 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.709259 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.709472 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.709561 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.709783 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.709872 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.710123 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.710255 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.710433 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.710520 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.710760 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.710847 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.711070 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.711170 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.711385 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.711473 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.711696 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.711784 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.712005 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.712099 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.712310 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.712397 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.712617 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.712711 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.712928 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.713021 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.713238 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.713325 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.713566 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.713652 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.713877 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.713965 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.714187 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.714292 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.714521 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.714607 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.714830 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.714918 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.715140 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.715230 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.715448 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.715534 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.715753 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.715848 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.716053 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.716139 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.716356 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.716454 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.716656 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.716743 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.716957 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.717042 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.717257 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.717352 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.717577 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.717672 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.717885 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.717979 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.718247 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.718351 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.718533 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.718619 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.718838 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.718924 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.719143 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.719238 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.719449 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.719545 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.719750 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.719836 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.720059 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.720146 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.720365 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.720451 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.720668 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.720763 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.720970 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.721058 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.721283 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.721376 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.721588 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.721695 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.721940 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.722043 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.722285 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.722506 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.722596 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.722817 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.722919 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.723133 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.723220 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.723444 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.723532 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.723755 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.723839 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.724066 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.724162 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.724374 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.724460 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.724694 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.724782 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.725008 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.725094 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.725316 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.725402 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.725649 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.725736 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.725977 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.726062 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.726310 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.726401 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.726636 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.726724 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.726958 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.727053 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.727274 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.727440 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.727574 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.727667 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.727880 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.727968 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.728181 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.728276 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.728483 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.728577 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.728789 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.728888 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.729088 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.729184 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.729387 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.729474 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.729687 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.729781 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.729992 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.730090 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.730320 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.730410 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.730624 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.730721 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.730942 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.731029 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.731246 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.731340 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.731548 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.731634 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.731849 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.731935 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.732149 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.732241 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.732490 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.732576 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.732791 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.732885 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.733129 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.733215 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.733462 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.733549 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.733780 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.733867 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.734099 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.734184 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.734434 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.734534 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.734744 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.734830 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.735052 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.735138 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.735358 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.735451 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.735666 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.735753 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.735978 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.736073 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.736296 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.736391 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.736604 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.736692 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.736923 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.737010 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.737231 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.737364 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.737586 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.737749 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.737895 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.738147 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.738294 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.738540 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.738641 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.738841 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.738939 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.739171 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.739268 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.739504 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.739598 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.739821 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.739908 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.740142 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.740237 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.740451 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.740538 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.740758 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.740844 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.741063 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.741163 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.741366 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.741452 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.741671 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.741757 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.741978 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.742073 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.742311 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.742413 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.742619 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.742707 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.742927 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.743013 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.743231 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.743316 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.743536 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.743622 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.743843 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.743930 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.744152 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.744238 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.744450 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.744535 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.744755 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.744842 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.745070 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.745203 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.745395 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.745501 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.745700 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.745794 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.746009 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.746105 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.746347 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.746447 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.746656 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.746750 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.746964 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.747052 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.747267 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.747361 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.747570 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.747657 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.747870 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.747957 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.748172 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.748268 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.748478 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.748565 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.748783 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.748868 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.749086 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.749184 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.749387 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.749473 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.749685 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.749778 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.749998 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.750084 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.750321 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.750414 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.750621 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.750707 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.750922 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.751010 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.751239 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.751325 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.751547 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.751634 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.751881 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.751984 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.752249 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.752351 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.752491 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.752607 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.752792 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.753525 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.753649 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.753923 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.754011 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.754338 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.754441 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.754566 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.754656 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.754870 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.754957 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.755170 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.755265 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.755473 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.755568 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.755795 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.755881 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.756108 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.756196 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.756409 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.756495 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.756722 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.756810 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.757037 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.757127 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.757342 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.757435 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.757646 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.757733 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.757950 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.758044 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.758281 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.758374 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.758589 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.758688 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.758899 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.758987 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.759202 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.759288 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.759509 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.759604 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.759814 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.759901 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.760122 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.760209 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.760433 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.760529 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.760741 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.760829 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.761043 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.761171 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.761342 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.761445 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.761645 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.761731 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.761947 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.762042 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.762284 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.762548 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.762636 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.762880 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.763153 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.763242 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.763483 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.763572 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.763796 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.763884 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.764110 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.764197 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.764425 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.764511 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.764742 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.764829 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.765069 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.765170 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.765387 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.765485 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.765697 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.765785 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.766004 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.766101 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.766334 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.766428 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.766638 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.766726 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.766940 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.767026 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.767247 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.767333 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.767547 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.767634 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.767856 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.767954 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.768157 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.768247 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.768461 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.768615 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.769410 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.769598 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.769688 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.769780 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.769987 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.770076 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.770324 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.770415 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.770641 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.770732 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.770947 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.771025 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.771269 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.771347 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.771570 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.771655 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.771873 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.771949 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.772177 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.772297 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.772482 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.772611 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.772826 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.772915 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.773131 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.773220 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.773468 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.773570 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.773796 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.773891 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.774135 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.774245 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.774481 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.774572 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.774788 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.774885 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.775111 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.775199 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.775415 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.775504 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.775719 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.775816 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.776021 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.776117 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.776321 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.776414 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.776623 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.776711 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.776922 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.777017 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.777224 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.777312 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.777526 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.777614 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.777830 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.777924 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.778133 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.778301 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.778463 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.778551 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.778767 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.778867 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.779069 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.779155 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.779371 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.779464 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.779672 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.779770 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.779972 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.780066 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.780278 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.780367 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.780576 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.780670 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.780875 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.780964 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.781174 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.781260 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.781476 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.781566 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.781777 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.781871 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.782082 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.782168 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.782410 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.782511 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.782714 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.782808 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.783015 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.783102 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.783319 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.783409 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.783620 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.783709 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.783974 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.784086 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.784252 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.784343 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.784570 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.785869 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.785969 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.786052 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.786123 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.786226 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.786302 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.786370 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.786437 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.786519 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.786589 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.786665 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.786740 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.786821 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.786890 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.786970 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.787039 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.787113 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.787256 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.787389 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.787563 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.787705 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.787868 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.788006 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.788172 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.788314 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.788474 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.788616 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.788779 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.788911 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.789078 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.789207 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.789380 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.789512 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.789680 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.789810 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.789980 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.790116 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.790307 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.790440 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.790630 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.790726 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.790935 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.791032 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.791237 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.791326 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.791539 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.791627 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.791842 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.791938 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.792183 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.792272 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.792483 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.792570 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.792822 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.792919 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.793124 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.793213 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.793435 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.793522 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.793753 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.793854 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.794061 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.794147 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.794392 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.794494 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.794700 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.794788 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.795000 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.795087 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.795309 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.795395 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.795609 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.795699 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.795918 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.796004 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.796220 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.796308 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.796523 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.796612 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.796822 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.796916 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.797124 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.797219 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.797431 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.797520 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.797740 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.797875 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.798055 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.798155 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.798414 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.798518 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.798718 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.798807 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.799029 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.799126 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.799337 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.799426 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.799645 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.799734 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.799979 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.800116 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.800293 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.800425 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.800601 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.800733 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.800909 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.801043 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.801216 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.801349 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.801524 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.801657 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.801829 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.801963 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.802134 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.802354 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.802453 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.802591 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.802758 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.802895 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.803060 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.803200 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.803380 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.803506 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.803685 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.803807 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.803985 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.804125 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.804290 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.804430 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.804593 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.804730 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.804902 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.805033 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.805204 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.805333 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.805640 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.805726 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.805940 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.806034 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.806281 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.806422 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.806589 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.806687 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.806897 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.806985 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.807206 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.807307 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.807517 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.807606 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.807829 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.807917 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.808131 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.808229 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.808467 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.808553 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.808768 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.808856 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.809139 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.809235 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.809449 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.809544 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.809750 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.809839 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.810050 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.810141 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.810381 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.810471 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.810684 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.810773 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.810992 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.811080 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.811294 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.811381 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.811597 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.811689 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.811898 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.811986 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.812199 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.812288 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.812514 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.812610 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.812812 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.812941 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.813127 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.813251 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.813650 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.813766 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.813959 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.814055 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.814286 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.814380 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.814682 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.814782 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.814998 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.815086 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.815306 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.815919 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.816145 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.816331 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.816459 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.816656 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.816849 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.816983 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.817160 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.817286 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.817487 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.817585 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.817811 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.817901 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.818124 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.818267 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.818464 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.818571 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.818770 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.818859 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.819092 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.819185 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.819414 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.819504 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.819725 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.819821 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.820043 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.820130 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.820356 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.820466 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.820681 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.820777 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.821086 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.821173 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.821405 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.821494 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.821714 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.821804 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.822017 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.822117 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.822520 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.822632 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.822853 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.822957 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.823142 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.823386 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.824120 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.824221 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.824304 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.824639 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.824721 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.824817 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.824908 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.824991 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.825070 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.825140 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.825226 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.825321 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.825492 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.825589 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.825794 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.825897 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.826114 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.826256 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.826441 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.826531 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.826764 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.826853 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.827075 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.827166 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.827395 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.827482 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.827709 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.827795 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.828009 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.828097 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.828328 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.828426 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.828630 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.828716 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.828933 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.829029 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.829228 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.829325 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.829528 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.829624 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.829832 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.829924 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.830137 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.830246 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.830492 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.830594 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.830800 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.830895 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.831200 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.831849 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.832084 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.832231 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.832417 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.832667 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.832756 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.833002 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.833090 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.833321 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.833410 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.833642 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.833731 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.833964 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.834061 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.834300 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.834393 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.834607 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.834708 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.834916 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.835014 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.835222 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.835311 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.835526 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.835614 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.835997 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.836137 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.836255 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.836365 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.836474 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.836565 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.836702 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.836790 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.837001 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.837089 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.837302 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.837391 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.837609 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.837705 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.837910 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.837998 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.838243 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.838332 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.838551 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.838642 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.838851 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.838939 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.839151 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.839238 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.839453 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.839542 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.839776 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.839863 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.840078 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.840166 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.840414 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.840504 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.840731 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.840810 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.841050 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.841136 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.841356 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.841433 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.841665 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.841759 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.841978 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.842077 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.842313 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.842416 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.842628 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.842717 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.842939 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.843037 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.843250 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.843337 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.843561 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.843647 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.843872 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.843967 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.844177 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.844264 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.844480 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.844567 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.844793 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.844883 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.845105 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.845190 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.845418 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.845675 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.845972 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.846062 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.846322 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.846427 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.846662 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.846761 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.847070 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.847158 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.847524 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.847635 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.847763 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.847940 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.848076 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.848391 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.848554 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.848699 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.849166 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.849279 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.849364 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.849591 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.849682 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.849944 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.850177 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.850316 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.850554 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.850651 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.850891 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.850978 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.851228 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.851328 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.851538 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.851625 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.851851 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.851946 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.852200 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.852290 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.852512 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.852599 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.852817 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.852949 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.853130 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.853221 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.853443 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.853533 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.853755 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.853851 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.854065 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.854154 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.854400 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.854504 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.854711 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.854811 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.855020 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.855115 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.855332 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.855420 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.855638 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.855725 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.855949 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.856038 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.856259 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.856347 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.856570 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.856660 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.856884 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.856974 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.857196 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.857292 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.857505 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.857593 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.857816 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.857904 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.858129 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.858254 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.858492 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.858702 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.858791 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.859016 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.859104 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.859351 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.859636 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.859767 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.859955 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.860050 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.860300 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.860411 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.860614 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.860703 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.860936 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.861024 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.861240 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.861343 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.861542 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.861633 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.861849 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.861938 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.862154 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.862825 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.863009 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.863156 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.863418 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.863547 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.863781 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.863874 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.864090 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.864177 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.864407 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.864502 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.864715 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.864811 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.865061 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.865257 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.865382 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.865612 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.865709 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.865931 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.866233 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.866339 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.866587 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.866686 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.866904 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.866991 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.867212 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.867301 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.867538 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.867635 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.867845 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.867934 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.868148 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.868238 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.868460 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.868556 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.868766 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.868853 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.869068 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.869162 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.869371 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.869470 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.869678 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.869809 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.869984 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.870075 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.870307 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.870399 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.870619 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.870709 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.870926 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.871015 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.871228 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.871315 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.871538 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.871634 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.871838 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.871924 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.872140 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.872230 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.872448 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.872535 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.872749 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.872844 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.873050 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.873138 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.873359 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.873487 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.873663 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.873794 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.873968 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.874106 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.874299 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.874435 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.874607 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.874741 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.874918 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.875042 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.875222 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.875351 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.875531 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.875653 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.875835 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.876060 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.876163 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.876419 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.876510 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.876786 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.876886 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.877038 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.877129 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.877331 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.877536 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.877651 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.877742 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.878011 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.878619 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.878876 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.878989 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.879223 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.879313 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.879578 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.879677 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.879929 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.880077 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.880245 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.880341 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.880595 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.880799 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.880915 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.881134 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.881456 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.881551 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.881788 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.881876 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.882108 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.882244 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.882441 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.882535 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.882745 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.882833 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.883049 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.883140 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.883369 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.883456 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.883675 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.883775 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.883982 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.884078 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.884290 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.884379 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.884597 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.884685 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.884904 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.884992 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.885209 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.885304 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.885516 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.885611 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.885822 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.885910 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.886127 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.886233 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.886457 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.886559 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.886762 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.886858 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.887067 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.887155 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.887374 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.887472 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.887680 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.887770 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.887993 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.888082 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.888317 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.888405 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.888628 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.888717 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.888941 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.889028 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.889246 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.889341 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.889551 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.889648 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.889857 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.889952 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.890165 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.890322 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.890493 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.890583 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.890818 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.890919 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.891125 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.891213 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.891429 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.891517 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.891748 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.891842 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.892052 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.892140 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.892457 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.892545 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.892773 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.892868 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.893080 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.893167 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.893399 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.893550 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.893776 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.894079 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.894184 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.894475 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.894605 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.894790 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.894933 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.895103 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.895256 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.895435 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.895567 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.895774 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.895898 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.896103 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.896240 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.896427 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.896567 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.896733 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.896892 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.897037 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.897199 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.897339 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.897503 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.897646 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.897821 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.897965 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.898115 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.898363 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.898456 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.898671 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.898762 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.898973 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.899070 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.899280 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.899369 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.899582 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.899671 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.899885 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.899974 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.900186 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.900278 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.900488 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.900573 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.900795 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.900883 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.901095 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.901193 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.901394 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.901481 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.901691 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.901778 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.901991 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.902088 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.902364 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.902461 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.902615 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.902703 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.902916 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.903017 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.903219 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.903307 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.903517 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.903647 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.903817 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.903912 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.904114 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.904202 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.904414 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.904501 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.904713 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.904803 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.905042 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.905131 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.905353 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.905440 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.905673 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.905761 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.905978 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.906112 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.906311 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.906414 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.906617 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.906706 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.906925 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.907013 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.907241 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.907337 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.907557 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.907647 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.907863 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.907961 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.908168 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.908269 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.908485 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.908573 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.908793 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.908883 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.909099 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.909217 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.909445 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.909696 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.909856 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.910052 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.910151 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.912027 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.912169 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.912260 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.912332 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.912409 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.912488 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.912558 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.913503 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.913596 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.913679 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.913749 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.913900 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.913985 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.914073 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.914169 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.914315 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.914409 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.914504 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.914587 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.914667 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.914747 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.914833 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.914923 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.915005 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.915085 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.915172 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.915262 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.915344 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.915432 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.915515 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.915594 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.915674 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.915754 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.915842 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.915924 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.916005 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.916090 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.916160 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.916227 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.916307 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.916500 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.916600 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.916823 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.916912 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.917172 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.917269 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.917487 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.917576 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.917833 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.917929 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.918157 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.918289 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.918494 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.918584 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.918803 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.918890 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.919103 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.919191 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:13:43.919346 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 13:13:43.919436 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 13:13:43.944276 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG oslo_db.sqlalchemy.engines [None req-29ccf1ce-ba94-45fe-a88a-9772cc38e93a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:13:43.945832 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG oslo_db.sqlalchemy.engines [None req-a1ac2790-604c-4bb6-a066-8f755ec02fb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:13:44.010414 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.context [None req-29ccf1ce-ba94-45fe-a88a-9772cc38e93a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ed747a63-75f5-43f4-a721-9b3138eb67b0(cell1) {{(pid=103314) load_cells /opt/stack/nova/nova/context.py:464}} May 13 13:13:44.011344 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.context [None req-a1ac2790-604c-4bb6-a066-8f755ec02fb9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ed747a63-75f5-43f4-a721-9b3138eb67b0(cell1) {{(pid=103315) load_cells /opt/stack/nova/nova/context.py:464}} May 13 13:13:44.014800 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-29ccf1ce-ba94-45fe-a88a-9772cc38e93a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:13:44.015685 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG oslo_concurrency.lockutils [None req-a1ac2790-604c-4bb6-a066-8f755ec02fb9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:13:44.016413 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-29ccf1ce-ba94-45fe-a88a-9772cc38e93a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:13:44.017269 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-29ccf1ce-ba94-45fe-a88a-9772cc38e93a None None] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:13:44.017373 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG oslo_concurrency.lockutils [None req-a1ac2790-604c-4bb6-a066-8f755ec02fb9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:13:44.018075 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG oslo_concurrency.lockutils [None req-a1ac2790-604c-4bb6-a066-8f755ec02fb9 None None] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:13:44.019295 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-29ccf1ce-ba94-45fe-a88a-9772cc38e93a None None] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:13:44.020183 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG oslo_concurrency.lockutils [None req-a1ac2790-604c-4bb6-a066-8f755ec02fb9 None None] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:13:44.032783 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG oslo_db.sqlalchemy.engines [None req-29ccf1ce-ba94-45fe-a88a-9772cc38e93a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:13:44.034411 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG oslo_db.sqlalchemy.engines [None req-29ccf1ce-ba94-45fe-a88a-9772cc38e93a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:13:44.039967 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG oslo_db.sqlalchemy.engines [None req-a1ac2790-604c-4bb6-a066-8f755ec02fb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:13:44.042857 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG oslo_db.sqlalchemy.engines [None req-a1ac2790-604c-4bb6-a066-8f755ec02fb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:13:44.205955 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG oslo_db.sqlalchemy.engines [None req-29ccf1ce-ba94-45fe-a88a-9772cc38e93a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:13:44.209248 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG oslo_db.sqlalchemy.engines [None req-a1ac2790-604c-4bb6-a066-8f755ec02fb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:13:44.629306 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: WARNING keystonemiddleware.auth_token [None req-29ccf1ce-ba94-45fe-a88a-9772cc38e93a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:13:44.636904 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: WARNING keystonemiddleware.auth_token [None req-29ccf1ce-ba94-45fe-a88a-9772cc38e93a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:13:44.662580 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: WARNING keystonemiddleware.auth_token [None req-a1ac2790-604c-4bb6-a066-8f755ec02fb9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:13:44.671066 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: WARNING keystonemiddleware.auth_token [None req-a1ac2790-604c-4bb6-a066-8f755ec02fb9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:13:44.991076 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: WARNING keystonemiddleware.auth_token [None req-29ccf1ce-ba94-45fe-a88a-9772cc38e93a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:13:44.997166 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: WARNING keystonemiddleware.auth_token [None req-29ccf1ce-ba94-45fe-a88a-9772cc38e93a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:13:45.003455 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5641d59899c0 pid: 103314 (default app) May 13 13:13:45.006242 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-29ccf1ce-ba94-45fe-a88a-9772cc38e93a None None] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:13:45.007709 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-29ccf1ce-ba94-45fe-a88a-9772cc38e93a None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002130 May 13 13:13:45.008127 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Fri May 13 13:13:45 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:13:45.024149 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: WARNING keystonemiddleware.auth_token [None req-a1ac2790-604c-4bb6-a066-8f755ec02fb9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:13:45.031438 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: WARNING keystonemiddleware.auth_token [None req-a1ac2790-604c-4bb6-a066-8f755ec02fb9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:13:45.037395 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5641d59899c0 pid: 103315 (default app) May 13 13:15:10.057163 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-29ccf1ce-ba94-45fe-a88a-9772cc38e93a None None] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:15:10.058865 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-29ccf1ce-ba94-45fe-a88a-9772cc38e93a None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002173 May 13 13:15:10.059531 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 2/2] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 13 13:15:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:15:10.525692 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-47b1b10c-2bf1-459c-8b76-9bd97e734ef5 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:15:10.561086 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-47b1b10c-2bf1-459c-8b76-9bd97e734ef5 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.491623 May 13 13:15:10.561884 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 1/3] 10.222.0.13 () {60 vars in 1291 bytes} [Fri May 13 13:15:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:15:12.929551 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-29ccf1ce-ba94-45fe-a88a-9772cc38e93a None None] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:15:12.930588 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-29ccf1ce-ba94-45fe-a88a-9772cc38e93a None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 May 13 13:15:12.931002 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 3/4] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 13 13:15:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:15:12.991890 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-5ec157ec-4704-4c49-a153-6d97106fefd9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "ram": 256, "name": "cirros256", "rxtx_factor": 1.0, "id": "c1", "disk": 1}} {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:15:13.010739 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:15:13.010739 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: warnings.warn(msg) May 13 13:15:13.100263 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-5ec157ec-4704-4c49-a153-6d97106fefd9 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.163166 May 13 13:15:13.100987 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 2/5] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 13 13:15:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:15:13.320054 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-700abf9c-8786-466f-b739-b5b80229fe87 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:15:13.322524 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:15:13.322524 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: warnings.warn(msg) May 13 13:15:13.450757 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-700abf9c-8786-466f-b739-b5b80229fe87 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.341851 May 13 13:15:13.451677 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 4/6] 10.222.0.13 () {64 vars in 1335 bytes} [Fri May 13 13:15:13 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:15:15.795693 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-5ec157ec-4704-4c49-a153-6d97106fefd9 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:15:15.797315 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-5ec157ec-4704-4c49-a153-6d97106fefd9 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002072 May 13 13:15:15.797943 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 3/7] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 13 13:15:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:15:15.919607 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-c23e126a-ed7a-4413-ba8b-b305aad0ca97 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds512M", "swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "disk": 5}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:15:15.937404 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:15:15.937404 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: warnings.warn(msg) May 13 13:15:16.028838 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-c23e126a-ed7a-4413-ba8b-b305aad0ca97 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.224294 May 13 13:15:16.029314 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 5/8] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 13 13:15:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:15:16.041334 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-eaf0bad8-d672-4b43-925a-152fc1ac34a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:15:16.042983 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:15:16.042983 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: warnings.warn(msg) May 13 13:15:16.134684 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-eaf0bad8-d672-4b43-925a-152fc1ac34a7 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097044 May 13 13:15:16.135284 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 4/9] 10.222.0.13 () {64 vars in 1335 bytes} [Fri May 13 13:15:16 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:15:18.479288 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-c23e126a-ed7a-4413-ba8b-b305aad0ca97 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:15:18.480331 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-c23e126a-ed7a-4413-ba8b-b305aad0ca97 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001703 May 13 13:15:18.480734 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 6/10] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 13 13:15:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:15:18.546222 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-72c705b1-10a2-4642-85dc-15cdd8d29763 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "disk": 10, "name": "ds1G", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2"}} {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:15:18.625607 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-72c705b1-10a2-4642-85dc-15cdd8d29763 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.137670 May 13 13:15:18.627106 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 5/11] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 13 13:15:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 13:15:18.639056 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-e4b667bf-4283-4469-a401-66b3fa4dac83 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:15:18.706583 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-e4b667bf-4283-4469-a401-66b3fa4dac83 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.071101 May 13 13:15:18.707360 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 7/12] 10.222.0.13 () {64 vars in 1335 bytes} [Fri May 13 13:15:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:15:21.303903 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-72c705b1-10a2-4642-85dc-15cdd8d29763 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:15:21.304922 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-72c705b1-10a2-4642-85dc-15cdd8d29763 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 13 13:15:21.305323 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 6/13] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 13 13:15:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:15:21.365633 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-a719b153-aed6-4eae-addb-a11fdf536a72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "name": "ds2G"}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:15:21.444836 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-a719b153-aed6-4eae-addb-a11fdf536a72 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.133468 May 13 13:15:21.445385 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 8/14] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 13 13:15:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:15:21.458522 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-aa8d79b2-980f-4879-9605-b4f76df4d5ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:15:21.551155 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-aa8d79b2-980f-4879-9605-b4f76df4d5ce admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096767 May 13 13:15:21.551834 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 7/15] 10.222.0.13 () {64 vars in 1335 bytes} [Fri May 13 13:15:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:15:23.919389 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-a719b153-aed6-4eae-addb-a11fdf536a72 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:15:23.920405 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-a719b153-aed6-4eae-addb-a11fdf536a72 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 13 13:15:23.920823 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 9/16] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 13 13:15:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:15:23.981770 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-19ad17d9-1486-40da-842d-364cce383f72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "swap": 0, "ram": 4096, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:15:24.058153 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-19ad17d9-1486-40da-842d-364cce383f72 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.130476 May 13 13:15:24.059099 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 8/17] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 13 13:15:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 13:15:24.071963 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-70df7728-f3ee-486c-8a6f-6700a14d918d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:15:24.182734 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-70df7728-f3ee-486c-8a6f-6700a14d918d admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114008 May 13 13:15:24.183340 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 10/18] 10.222.0.13 () {64 vars in 1335 bytes} [Fri May 13 13:15:24 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:15:26.531202 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-19ad17d9-1486-40da-842d-364cce383f72 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:15:26.532216 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-19ad17d9-1486-40da-842d-364cce383f72 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 May 13 13:15:26.532650 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 9/19] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 13 13:15:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:15:26.596661 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-a11130cd-5f9e-4015-86f9-ddf2aab940c5 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:15:26.621563 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-a11130cd-5f9e-4015-86f9-ddf2aab940c5 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082271 May 13 13:15:26.622108 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 11/20] 10.222.0.13 () {60 vars in 1291 bytes} [Fri May 13 13:15:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:15:28.975481 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-19ad17d9-1486-40da-842d-364cce383f72 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:15:28.976843 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-19ad17d9-1486-40da-842d-364cce383f72 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001965 May 13 13:15:28.977346 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 10/21] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 13 13:15:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:15:29.049582 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-0de43dda-36d5-4f8f-9836-767c75c81d65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "id": "1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny"}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:15:29.136723 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-0de43dda-36d5-4f8f-9836-767c75c81d65 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.152253 May 13 13:15:29.137307 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 12/22] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 13 13:15:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 13:15:29.151187 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-2e8ef2e0-0126-44b2-ab4a-9dcdf55216cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:15:29.339292 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-2e8ef2e0-0126-44b2-ab4a-9dcdf55216cb admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.191917 May 13 13:15:29.339864 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 11/23] 10.222.0.13 () {64 vars in 1332 bytes} [Fri May 13 13:15:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:15:31.981803 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-0de43dda-36d5-4f8f-9836-767c75c81d65 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:15:31.982898 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-0de43dda-36d5-4f8f-9836-767c75c81d65 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 May 13 13:15:31.983344 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 13/24] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 13 13:15:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:15:32.051670 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-e3287d41-2c2c-45c7-b175-8a361ed66b71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048, "disk": 20, "rxtx_factor": 1.0}} {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:15:32.150781 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-e3287d41-2c2c-45c7-b175-8a361ed66b71 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.159756 May 13 13:15:32.151408 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 12/25] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 13 13:15:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:15:32.168671 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-b875af98-5bf3-4b97-9ba0-8ac022379f66 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:15:32.288599 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-b875af98-5bf3-4b97-9ba0-8ac022379f66 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125403 May 13 13:15:32.289232 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 14/26] 10.222.0.13 () {64 vars in 1332 bytes} [Fri May 13 13:15:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:15:34.713703 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-e3287d41-2c2c-45c7-b175-8a361ed66b71 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:15:34.714989 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-e3287d41-2c2c-45c7-b175-8a361ed66b71 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001689 May 13 13:15:34.715509 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 13/27] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 13 13:15:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:15:34.784126 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-3333c3ab-97df-49c6-98ed-d231c0d3cf5f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 40, "id": "3", "name": "m1.medium", "vcpus": 2}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:15:34.855720 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-3333c3ab-97df-49c6-98ed-d231c0d3cf5f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.132792 May 13 13:15:34.856359 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 15/28] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 13 13:15:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:15:34.869330 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-ce299037-a907-4f92-af90-f88821106050 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:15:34.958324 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-ce299037-a907-4f92-af90-f88821106050 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092696 May 13 13:15:34.958912 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 14/29] 10.222.0.13 () {64 vars in 1332 bytes} [Fri May 13 13:15:34 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:15:37.300304 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-3333c3ab-97df-49c6-98ed-d231c0d3cf5f admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:15:37.301423 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-3333c3ab-97df-49c6-98ed-d231c0d3cf5f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 May 13 13:15:37.302434 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 16/30] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 13 13:15:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:15:37.382595 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-fbf26c74-d07e-416d-8da5-f467134f3c0f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "vcpus": 4, "name": "m1.large", "os-flavor-access:is_public": true, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 80}} {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:15:37.462782 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-fbf26c74-d07e-416d-8da5-f467134f3c0f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.153956 May 13 13:15:37.465004 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 15/31] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 13 13:15:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:15:37.480247 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-a26cfac1-d240-40ff-94ac-eaaf4bf88cbf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:15:37.546089 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-a26cfac1-d240-40ff-94ac-eaaf4bf88cbf admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.069661 May 13 13:15:37.547063 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 17/32] 10.222.0.13 () {64 vars in 1332 bytes} [Fri May 13 13:15:37 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:15:39.935385 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-fbf26c74-d07e-416d-8da5-f467134f3c0f admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:15:39.936404 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-fbf26c74-d07e-416d-8da5-f467134f3c0f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 May 13 13:15:39.937003 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 16/33] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 13 13:15:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:15:40.004771 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-85fb0f89-7b09-48d0-a4d9-2926076c222c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "name": "m1.xlarge", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "id": "5", "rxtx_factor": 1.0, "swap": 0}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:15:40.104958 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-85fb0f89-7b09-48d0-a4d9-2926076c222c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.159165 May 13 13:15:40.105573 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 18/34] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 13 13:15:39 2022] POST /compute/v2.1/flavors => generated 408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:15:40.122707 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-c1340cab-c409-47a0-a596-54d26a4d87f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:15:40.220398 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-c1340cab-c409-47a0-a596-54d26a4d87f1 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103909 May 13 13:15:40.221015 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 17/35] 10.222.0.13 () {64 vars in 1332 bytes} [Fri May 13 13:15:40 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:16:04.464505 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-85fb0f89-7b09-48d0-a4d9-2926076c222c admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:16:04.465434 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-85fb0f89-7b09-48d0-a4d9-2926076c222c admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 May 13 13:16:04.465837 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 19/36] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 13 13:16:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:16:04.526828 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-2a2dc8a0-1fbf-4232-b465-3d9efdb3b8f9 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:16:04.544556 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-2a2dc8a0-1fbf-4232-b465-3d9efdb3b8f9 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071223 May 13 13:16:04.545094 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1291 bytes} [Fri May 13 13:16:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:16:05.574641 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-85fb0f89-7b09-48d0-a4d9-2926076c222c admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:16:05.575563 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-85fb0f89-7b09-48d0-a4d9-2926076c222c admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001633 May 13 13:16:05.575959 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 20/38] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 13 13:16:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:16:05.773714 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-fc0e1e5f-b2cb-441a-b4b7-f3cde8430631 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:16:05.779236 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.wsgi [None req-fc0e1e5f-b2cb-441a-b4b7-f3cde8430631 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 13 13:16:05.783617 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-fc0e1e5f-b2cb-441a-b4b7-f3cde8430631 admin admin] Request method failure captured: May 13 13:16:05.783617 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 13 13:16:05.783617 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: Accept: application/json May 13 13:16:05.783617 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: Accept-Encoding: gzip, deflate May 13 13:16:05.783617 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: Connection: keep-alive May 13 13:16:05.783617 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: Content-Length: 0 May 13 13:16:05.783617 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: Host: 10.222.0.13 May 13 13:16:05.783617 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: Openstack-Api-Version: compute 2.90 May 13 13:16:05.783617 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: Openstack-System-Scope: None May 13 13:16:05.783617 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: User-Agent: python-novaclient May 13 13:16:05.783617 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Auth-Token: gAAAAABifloVcCy5Zxkn0his44ECPbyE0SJRlVO6RIqNPxPAHAnI6tgO_Bq7v63xhYPbFB8xUJN1UCyqh-_zjwlvBgZo5WdWewBXZ7KlhjRIipJ6j-2ZrdRItAt3rmYjIESxoPHSQzxIq1xscPAzT6hmBRzJqhDFkkZ-vencyYJP20wUl7PKT8Q May 13 13:16:05.783617 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Domain-Id: None May 13 13:16:05.783617 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Domain-Name: None May 13 13:16:05.783617 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Identity-Status: Confirmed May 13 13:16:05.783617 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Is-Admin-Project: True May 13 13:16:05.783617 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Openstack-Nova-Api-Version: 2.90 May 13 13:16:05.783617 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Project-Domain-Id: default May 13 13:16:05.783617 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Project-Domain-Name: Default May 13 13:16:05.783617 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Project-Id: 51195917460547f8a30dcb35058f5c2c May 13 13:16:05.783617 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Project-Name: admin May 13 13:16:05.783617 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Role: admin,member,reader May 13 13:16:05.783617 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Roles: admin,member,reader May 13 13:16:05.785296 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_51195917460547f8a30dcb35058f5c2c", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51195917460547f8a30dcb35058f5c2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/51195917460547f8a30dcb35058f5c2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51195917460547f8a30dcb35058f5c2c"}]}] May 13 13:16:05.785296 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Tenant: admin May 13 13:16:05.785296 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Tenant-Id: 51195917460547f8a30dcb35058f5c2c May 13 13:16:05.785296 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Tenant-Name: admin May 13 13:16:05.785296 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-User: admin May 13 13:16:05.785296 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-User-Domain-Id: default May 13 13:16:05.785296 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-User-Domain-Name: Default May 13 13:16:05.785296 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-User-Id: 61e4ab1d0e8a4ecfbddf847d909467b3 May 13 13:16:05.785296 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-User-Name: admin May 13 13:16:05.785296 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: method: > May 13 13:16:05.785296 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: exception: Flavor 42 could not be found. May 13 13:16:05.785296 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: action_args: {'id': '42'} May 13 13:16:05.785296 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:16:05.785296 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:16:05.786431 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 13:16:05.786431 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 13:16:05.786431 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 13:16:05.786431 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 13:16:05.786431 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 13:16:05.786431 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 13:16:05.786431 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 13:16:05.786431 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 13:16:05.786431 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 13:16:05.786431 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:16:05.786431 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 13:16:05.786431 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 13:16:05.786431 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 13 13:16:05.786431 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi May 13 13:16:05.786431 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:16:05.786431 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi May 13 13:16:05.786431 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:16:05.786431 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:16:05.786431 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:16:05.787796 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:16:05.787796 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:16:05.787796 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:16:05.787796 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:16:05.787796 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 13:16:05.787796 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 13:16:05.787796 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 13 13:16:05.787796 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi May 13 13:16:05.787796 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:16:05.787796 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi May 13 13:16:05.787796 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:16:05.787796 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:16:05.787796 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:16:05.787796 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:16:05.787796 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:16:05.787796 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 13 13:16:05.787796 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi May 13 13:16:05.787796 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-fc0e1e5f-b2cb-441a-b4b7-f3cde8430631 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:16:05.789078 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-fc0e1e5f-b2cb-441a-b4b7-f3cde8430631 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063035 May 13 13:16:05.789078 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 19/39] 10.222.0.13 () {60 vars in 1190 bytes} [Fri May 13 13:16:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 13:16:05.794759 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-cae17b48-dfdb-49f8-9b7b-92472d5ed059 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:16:05.817383 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-cae17b48-dfdb-49f8-9b7b-92472d5ed059 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026136 May 13 13:16:05.817918 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 21/40] 10.222.0.13 () {60 vars in 1210 bytes} [Fri May 13 13:16:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:16:05.832341 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-3e3a29fd-9c4a-493e-be50-5a12aa661a4a admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:16:05.853734 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-3e3a29fd-9c4a-493e-be50-5a12aa661a4a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025032 May 13 13:16:05.854296 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 20/41] 10.222.0.13 () {60 vars in 1210 bytes} [Fri May 13 13:16:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:16:05.864085 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-5743896e-157a-476a-8336-351041284f81 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:16:05.869559 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.wsgi [None req-5743896e-157a-476a-8336-351041284f81 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 13 13:16:05.872805 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-5743896e-157a-476a-8336-351041284f81 admin admin] Request method failure captured: May 13 13:16:05.872805 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 13 13:16:05.872805 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: Accept: application/json May 13 13:16:05.872805 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: Accept-Encoding: gzip, deflate May 13 13:16:05.872805 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: Connection: keep-alive May 13 13:16:05.872805 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: Content-Length: 0 May 13 13:16:05.872805 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: Host: 10.222.0.13 May 13 13:16:05.872805 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: Openstack-Api-Version: compute 2.90 May 13 13:16:05.872805 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: Openstack-System-Scope: None May 13 13:16:05.872805 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: User-Agent: python-novaclient May 13 13:16:05.872805 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Auth-Token: gAAAAABifloVcCy5Zxkn0his44ECPbyE0SJRlVO6RIqNPxPAHAnI6tgO_Bq7v63xhYPbFB8xUJN1UCyqh-_zjwlvBgZo5WdWewBXZ7KlhjRIipJ6j-2ZrdRItAt3rmYjIESxoPHSQzxIq1xscPAzT6hmBRzJqhDFkkZ-vencyYJP20wUl7PKT8Q May 13 13:16:05.872805 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Domain-Id: None May 13 13:16:05.872805 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Domain-Name: None May 13 13:16:05.872805 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Identity-Status: Confirmed May 13 13:16:05.872805 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Is-Admin-Project: True May 13 13:16:05.872805 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Openstack-Nova-Api-Version: 2.90 May 13 13:16:05.872805 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Project-Domain-Id: default May 13 13:16:05.872805 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Project-Domain-Name: Default May 13 13:16:05.872805 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Project-Id: 51195917460547f8a30dcb35058f5c2c May 13 13:16:05.872805 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Project-Name: admin May 13 13:16:05.872805 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Role: admin,member,reader May 13 13:16:05.872805 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Roles: admin,member,reader May 13 13:16:05.874436 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_51195917460547f8a30dcb35058f5c2c", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51195917460547f8a30dcb35058f5c2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/51195917460547f8a30dcb35058f5c2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51195917460547f8a30dcb35058f5c2c"}]}] May 13 13:16:05.874436 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Tenant: admin May 13 13:16:05.874436 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Tenant-Id: 51195917460547f8a30dcb35058f5c2c May 13 13:16:05.874436 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Tenant-Name: admin May 13 13:16:05.874436 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-User: admin May 13 13:16:05.874436 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-User-Domain-Id: default May 13 13:16:05.874436 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-User-Domain-Name: Default May 13 13:16:05.874436 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-User-Id: 61e4ab1d0e8a4ecfbddf847d909467b3 May 13 13:16:05.874436 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-User-Name: admin May 13 13:16:05.874436 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: method: > May 13 13:16:05.874436 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: exception: Flavor 42 could not be found. May 13 13:16:05.874436 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: action_args: {'id': '42'} May 13 13:16:05.874436 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:16:05.874436 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:16:05.875904 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 13:16:05.875904 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 13:16:05.875904 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 13:16:05.875904 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 13:16:05.875904 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 13:16:05.875904 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 13:16:05.875904 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 13:16:05.875904 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 13:16:05.875904 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 13:16:05.875904 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:16:05.875904 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 13:16:05.875904 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 13:16:05.875904 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 13 13:16:05.875904 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 13 13:16:05.875904 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:16:05.875904 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 13 13:16:05.875904 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:16:05.875904 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:16:05.875904 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:16:05.877826 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:16:05.877826 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:16:05.877826 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:16:05.877826 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:16:05.877826 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 13:16:05.877826 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 13:16:05.877826 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 13 13:16:05.877826 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 13 13:16:05.877826 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:16:05.877826 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 13 13:16:05.877826 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:16:05.877826 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:16:05.877826 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:16:05.877826 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:16:05.877826 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:16:05.877826 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 13 13:16:05.877826 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 13 13:16:05.877826 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-5743896e-157a-476a-8336-351041284f81 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:16:05.879144 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-5743896e-157a-476a-8336-351041284f81 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014495 May 13 13:16:05.879144 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 22/42] 10.222.0.13 () {60 vars in 1190 bytes} [Fri May 13 13:16:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 13:16:06.760191 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-3e3a29fd-9c4a-493e-be50-5a12aa661a4a admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:16:06.761212 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-3e3a29fd-9c4a-493e-be50-5a12aa661a4a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 May 13 13:16:06.761608 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 21/43] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 13 13:16:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:16:06.948098 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-8d44fe71-f52c-4acf-9fd1-05812f136d78 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:16:06.954297 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.wsgi [None req-8d44fe71-f52c-4acf-9fd1-05812f136d78 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 13 13:16:06.955811 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-8d44fe71-f52c-4acf-9fd1-05812f136d78 admin admin] Request method failure captured: May 13 13:16:06.955811 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 13 13:16:06.955811 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: Accept: application/json May 13 13:16:06.955811 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: Accept-Encoding: gzip, deflate May 13 13:16:06.955811 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: Connection: keep-alive May 13 13:16:06.955811 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: Content-Length: 0 May 13 13:16:06.955811 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: Host: 10.222.0.13 May 13 13:16:06.955811 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: Openstack-Api-Version: compute 2.90 May 13 13:16:06.955811 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: Openstack-System-Scope: None May 13 13:16:06.955811 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: User-Agent: python-novaclient May 13 13:16:06.955811 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Auth-Token: gAAAAABifloWoozrO3yZwMOvJ9Q4sHmiPvSwfQC1zzVRkdiYdBINEURrGwqLDQvACh4O8E4M55fWKb8OvUlVkKBs3QGXysVglAQJq1FooIN3IE519sjrQ9UlzvYRqN8yhtmcb_IOolzDASqQE5E5aF-1BGZHfJGi1QTUw6mAQhblMJJ6CrosEtk May 13 13:16:06.955811 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Domain-Id: None May 13 13:16:06.955811 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Domain-Name: None May 13 13:16:06.955811 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Identity-Status: Confirmed May 13 13:16:06.955811 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Is-Admin-Project: True May 13 13:16:06.955811 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Openstack-Nova-Api-Version: 2.90 May 13 13:16:06.955811 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Project-Domain-Id: default May 13 13:16:06.955811 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Project-Domain-Name: Default May 13 13:16:06.955811 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Project-Id: 51195917460547f8a30dcb35058f5c2c May 13 13:16:06.955811 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Project-Name: admin May 13 13:16:06.955811 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Role: admin,member,reader May 13 13:16:06.955811 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Roles: admin,member,reader May 13 13:16:06.957334 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_51195917460547f8a30dcb35058f5c2c", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51195917460547f8a30dcb35058f5c2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/51195917460547f8a30dcb35058f5c2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51195917460547f8a30dcb35058f5c2c"}]}] May 13 13:16:06.957334 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Tenant: admin May 13 13:16:06.957334 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Tenant-Id: 51195917460547f8a30dcb35058f5c2c May 13 13:16:06.957334 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Tenant-Name: admin May 13 13:16:06.957334 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-User: admin May 13 13:16:06.957334 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-User-Domain-Id: default May 13 13:16:06.957334 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-User-Domain-Name: Default May 13 13:16:06.957334 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-User-Id: 61e4ab1d0e8a4ecfbddf847d909467b3 May 13 13:16:06.957334 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-User-Name: admin May 13 13:16:06.957334 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: method: > May 13 13:16:06.957334 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: exception: Flavor 84 could not be found. May 13 13:16:06.957334 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: action_args: {'id': '84'} May 13 13:16:06.957334 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:16:06.957334 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:16:06.958242 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 13:16:06.958242 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 13:16:06.958242 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 13:16:06.958242 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 13:16:06.958242 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 13:16:06.958242 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 13:16:06.958242 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 13:16:06.958242 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 13:16:06.958242 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 13:16:06.958242 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:16:06.958242 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 13:16:06.958242 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 13:16:06.958242 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 13 13:16:06.958242 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 13 13:16:06.958242 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:16:06.958242 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 13 13:16:06.958242 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:16:06.958242 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:16:06.958242 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:16:06.959305 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:16:06.959305 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:16:06.959305 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:16:06.959305 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:16:06.959305 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 13:16:06.959305 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 13:16:06.959305 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 13 13:16:06.959305 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 13 13:16:06.959305 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:16:06.959305 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 13 13:16:06.959305 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:16:06.959305 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:16:06.959305 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:16:06.959305 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:16:06.959305 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:16:06.959305 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 13 13:16:06.959305 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 13 13:16:06.959305 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-8d44fe71-f52c-4acf-9fd1-05812f136d78 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:16:06.960367 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-8d44fe71-f52c-4acf-9fd1-05812f136d78 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059828 May 13 13:16:06.960367 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 23/44] 10.222.0.13 () {60 vars in 1190 bytes} [Fri May 13 13:16:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 13:16:06.967018 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-e1d1dfe4-d3df-4a84-b5e1-64df93e4f133 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:16:06.980936 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-e1d1dfe4-d3df-4a84-b5e1-64df93e4f133 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017372 May 13 13:16:06.981392 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 22/45] 10.222.0.13 () {60 vars in 1210 bytes} [Fri May 13 13:16:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:16:06.990671 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-db9ff9c8-6fea-4bf1-ae16-fffcd64e2731 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:16:07.004163 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-db9ff9c8-6fea-4bf1-ae16-fffcd64e2731 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016938 May 13 13:16:07.004690 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1210 bytes} [Fri May 13 13:16:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:16:07.014176 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-7eaf11a5-646d-4902-b254-cf85fda1c168 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:16:07.020038 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.wsgi [None req-7eaf11a5-646d-4902-b254-cf85fda1c168 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 13 13:16:07.021519 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-7eaf11a5-646d-4902-b254-cf85fda1c168 admin admin] Request method failure captured: May 13 13:16:07.021519 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 13 13:16:07.021519 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: Accept: application/json May 13 13:16:07.021519 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: Accept-Encoding: gzip, deflate May 13 13:16:07.021519 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: Connection: keep-alive May 13 13:16:07.021519 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: Content-Length: 0 May 13 13:16:07.021519 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: Host: 10.222.0.13 May 13 13:16:07.021519 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: Openstack-Api-Version: compute 2.90 May 13 13:16:07.021519 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: Openstack-System-Scope: None May 13 13:16:07.021519 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: User-Agent: python-novaclient May 13 13:16:07.021519 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Auth-Token: gAAAAABifloWoozrO3yZwMOvJ9Q4sHmiPvSwfQC1zzVRkdiYdBINEURrGwqLDQvACh4O8E4M55fWKb8OvUlVkKBs3QGXysVglAQJq1FooIN3IE519sjrQ9UlzvYRqN8yhtmcb_IOolzDASqQE5E5aF-1BGZHfJGi1QTUw6mAQhblMJJ6CrosEtk May 13 13:16:07.021519 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Domain-Id: None May 13 13:16:07.021519 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Domain-Name: None May 13 13:16:07.021519 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Identity-Status: Confirmed May 13 13:16:07.021519 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Is-Admin-Project: True May 13 13:16:07.021519 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Openstack-Nova-Api-Version: 2.90 May 13 13:16:07.021519 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Project-Domain-Id: default May 13 13:16:07.021519 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Project-Domain-Name: Default May 13 13:16:07.021519 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Project-Id: 51195917460547f8a30dcb35058f5c2c May 13 13:16:07.021519 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Project-Name: admin May 13 13:16:07.021519 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Role: admin,member,reader May 13 13:16:07.021519 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Roles: admin,member,reader May 13 13:16:07.023092 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_51195917460547f8a30dcb35058f5c2c", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51195917460547f8a30dcb35058f5c2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/51195917460547f8a30dcb35058f5c2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51195917460547f8a30dcb35058f5c2c"}]}] May 13 13:16:07.023092 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Tenant: admin May 13 13:16:07.023092 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Tenant-Id: 51195917460547f8a30dcb35058f5c2c May 13 13:16:07.023092 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Tenant-Name: admin May 13 13:16:07.023092 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-User: admin May 13 13:16:07.023092 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-User-Domain-Id: default May 13 13:16:07.023092 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-User-Domain-Name: Default May 13 13:16:07.023092 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-User-Id: 61e4ab1d0e8a4ecfbddf847d909467b3 May 13 13:16:07.023092 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-User-Name: admin May 13 13:16:07.023092 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: method: > May 13 13:16:07.023092 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: exception: Flavor 84 could not be found. May 13 13:16:07.023092 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: action_args: {'id': '84'} May 13 13:16:07.023092 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:16:07.023092 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:16:07.023948 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 13:16:07.023948 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 13:16:07.023948 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 13:16:07.023948 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 13:16:07.023948 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 13:16:07.023948 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 13:16:07.023948 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 13:16:07.023948 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 13:16:07.023948 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 13:16:07.023948 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:16:07.023948 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 13:16:07.023948 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 13:16:07.023948 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 13 13:16:07.023948 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi May 13 13:16:07.023948 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:16:07.023948 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi May 13 13:16:07.023948 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:16:07.023948 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:16:07.023948 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:16:07.025156 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:16:07.025156 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:16:07.025156 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:16:07.025156 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:16:07.025156 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 13:16:07.025156 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 13:16:07.025156 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 13 13:16:07.025156 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi May 13 13:16:07.025156 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:16:07.025156 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi May 13 13:16:07.025156 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:16:07.025156 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:16:07.025156 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:16:07.025156 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:16:07.025156 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:16:07.025156 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 13 13:16:07.025156 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi May 13 13:16:07.025156 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-7eaf11a5-646d-4902-b254-cf85fda1c168 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:16:07.026429 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-7eaf11a5-646d-4902-b254-cf85fda1c168 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012399 May 13 13:16:07.026429 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 23/47] 10.222.0.13 () {60 vars in 1190 bytes} [Fri May 13 13:16:07 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 13:16:07.915388 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-db9ff9c8-6fea-4bf1-ae16-fffcd64e2731 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:16:07.916391 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-db9ff9c8-6fea-4bf1-ae16-fffcd64e2731 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 May 13 13:16:07.916784 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 25/48] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 13 13:16:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:16:08.113505 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-acba86e8-09fa-475a-a13e-60183bd0317e admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:16:08.119264 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.wsgi [None req-acba86e8-09fa-475a-a13e-60183bd0317e admin admin] HTTP exception thrown: Flavor 451 could not be found. May 13 13:16:08.120742 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-acba86e8-09fa-475a-a13e-60183bd0317e admin admin] Request method failure captured: May 13 13:16:08.120742 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 13 13:16:08.120742 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: Accept: application/json May 13 13:16:08.120742 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: Accept-Encoding: gzip, deflate May 13 13:16:08.120742 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: Connection: keep-alive May 13 13:16:08.120742 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: Content-Length: 0 May 13 13:16:08.120742 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: Host: 10.222.0.13 May 13 13:16:08.120742 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: Openstack-Api-Version: compute 2.90 May 13 13:16:08.120742 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: Openstack-System-Scope: None May 13 13:16:08.120742 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: User-Agent: python-novaclient May 13 13:16:08.120742 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Auth-Token: gAAAAABifloXPY4FklCm-2BK-YVIJtSdP96Ebcuplgny3Qipi2IOLKokbN-yjTunuq7Vpc1X1bZQ80PMYRv9P9EcN2zURsW-JhOTULZ85Ked48okvSiAIXqrwfIx2hDW4EjAcZmLJse4orEAnDEUPIxEMdUt1ke1UeYEFOpXKwulvPQWsBIPhvg May 13 13:16:08.120742 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Domain-Id: None May 13 13:16:08.120742 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Domain-Name: None May 13 13:16:08.120742 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Identity-Status: Confirmed May 13 13:16:08.120742 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Is-Admin-Project: True May 13 13:16:08.120742 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Openstack-Nova-Api-Version: 2.90 May 13 13:16:08.120742 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Project-Domain-Id: default May 13 13:16:08.120742 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Project-Domain-Name: Default May 13 13:16:08.120742 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Project-Id: 51195917460547f8a30dcb35058f5c2c May 13 13:16:08.120742 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Project-Name: admin May 13 13:16:08.120742 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Role: admin,member,reader May 13 13:16:08.120742 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Roles: admin,member,reader May 13 13:16:08.122310 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_51195917460547f8a30dcb35058f5c2c", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51195917460547f8a30dcb35058f5c2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/51195917460547f8a30dcb35058f5c2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51195917460547f8a30dcb35058f5c2c"}]}] May 13 13:16:08.122310 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Tenant: admin May 13 13:16:08.122310 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Tenant-Id: 51195917460547f8a30dcb35058f5c2c May 13 13:16:08.122310 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-Tenant-Name: admin May 13 13:16:08.122310 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-User: admin May 13 13:16:08.122310 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-User-Domain-Id: default May 13 13:16:08.122310 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-User-Domain-Name: Default May 13 13:16:08.122310 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-User-Id: 61e4ab1d0e8a4ecfbddf847d909467b3 May 13 13:16:08.122310 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: X-User-Name: admin May 13 13:16:08.122310 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: method: > May 13 13:16:08.122310 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: exception: Flavor 451 could not be found. May 13 13:16:08.122310 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: action_args: {'id': '451'} May 13 13:16:08.122310 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:16:08.122310 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:16:08.123212 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 13:16:08.123212 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 13:16:08.123212 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 13:16:08.123212 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 13:16:08.123212 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 13:16:08.123212 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 13:16:08.123212 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 13:16:08.123212 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 13:16:08.123212 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 13:16:08.123212 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:16:08.123212 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 13:16:08.123212 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 13:16:08.123212 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 13 13:16:08.123212 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi May 13 13:16:08.123212 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:16:08.123212 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi May 13 13:16:08.123212 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:16:08.123212 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:16:08.123212 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:16:08.124293 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:16:08.124293 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:16:08.124293 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:16:08.124293 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:16:08.124293 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 13:16:08.124293 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 13:16:08.124293 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 13 13:16:08.124293 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi May 13 13:16:08.124293 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:16:08.124293 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi May 13 13:16:08.124293 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:16:08.124293 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:16:08.124293 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:16:08.124293 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:16:08.124293 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:16:08.124293 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 13 13:16:08.124293 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi May 13 13:16:08.124293 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-acba86e8-09fa-475a-a13e-60183bd0317e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:16:08.125397 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-acba86e8-09fa-475a-a13e-60183bd0317e admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.067749 May 13 13:16:08.125397 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 24/49] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 13 13:16:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 13:16:08.131927 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-3f60ecce-6a0f-4a57-88cd-f52ba6fc5d9e admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:16:08.145262 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-3f60ecce-6a0f-4a57-88cd-f52ba6fc5d9e admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016919 May 13 13:16:08.145837 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 26/50] 10.222.0.13 () {60 vars in 1210 bytes} [Fri May 13 13:16:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:16:08.155617 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-9b3dcf53-1848-4d4e-8117-cefe6a038521 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:16:08.169373 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-9b3dcf53-1848-4d4e-8117-cefe6a038521 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017556 May 13 13:16:08.169893 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 25/51] 10.222.0.13 () {60 vars in 1210 bytes} [Fri May 13 13:16:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:16:08.180071 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-730da420-cb20-44f4-b3b2-4569bd2331f7 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:16:08.185560 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.wsgi [None req-730da420-cb20-44f4-b3b2-4569bd2331f7 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 13 13:16:08.187157 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-730da420-cb20-44f4-b3b2-4569bd2331f7 admin admin] Request method failure captured: May 13 13:16:08.187157 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 13 13:16:08.187157 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: Accept: application/json May 13 13:16:08.187157 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: Accept-Encoding: gzip, deflate May 13 13:16:08.187157 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: Connection: keep-alive May 13 13:16:08.187157 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: Content-Length: 0 May 13 13:16:08.187157 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: Host: 10.222.0.13 May 13 13:16:08.187157 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: Openstack-Api-Version: compute 2.90 May 13 13:16:08.187157 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: Openstack-System-Scope: None May 13 13:16:08.187157 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: User-Agent: python-novaclient May 13 13:16:08.187157 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Auth-Token: gAAAAABifloXPY4FklCm-2BK-YVIJtSdP96Ebcuplgny3Qipi2IOLKokbN-yjTunuq7Vpc1X1bZQ80PMYRv9P9EcN2zURsW-JhOTULZ85Ked48okvSiAIXqrwfIx2hDW4EjAcZmLJse4orEAnDEUPIxEMdUt1ke1UeYEFOpXKwulvPQWsBIPhvg May 13 13:16:08.187157 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Domain-Id: None May 13 13:16:08.187157 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Domain-Name: None May 13 13:16:08.187157 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Identity-Status: Confirmed May 13 13:16:08.187157 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Is-Admin-Project: True May 13 13:16:08.187157 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Openstack-Nova-Api-Version: 2.90 May 13 13:16:08.187157 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Project-Domain-Id: default May 13 13:16:08.187157 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Project-Domain-Name: Default May 13 13:16:08.187157 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Project-Id: 51195917460547f8a30dcb35058f5c2c May 13 13:16:08.187157 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Project-Name: admin May 13 13:16:08.187157 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Role: admin,member,reader May 13 13:16:08.187157 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Roles: admin,member,reader May 13 13:16:08.188680 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_51195917460547f8a30dcb35058f5c2c", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51195917460547f8a30dcb35058f5c2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/51195917460547f8a30dcb35058f5c2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51195917460547f8a30dcb35058f5c2c"}]}] May 13 13:16:08.188680 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Tenant: admin May 13 13:16:08.188680 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Tenant-Id: 51195917460547f8a30dcb35058f5c2c May 13 13:16:08.188680 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-Tenant-Name: admin May 13 13:16:08.188680 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-User: admin May 13 13:16:08.188680 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-User-Domain-Id: default May 13 13:16:08.188680 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-User-Domain-Name: Default May 13 13:16:08.188680 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-User-Id: 61e4ab1d0e8a4ecfbddf847d909467b3 May 13 13:16:08.188680 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: X-User-Name: admin May 13 13:16:08.188680 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: method: > May 13 13:16:08.188680 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: exception: Flavor 451 could not be found. May 13 13:16:08.188680 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: action_args: {'id': '451'} May 13 13:16:08.188680 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:16:08.188680 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:16:08.189478 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 13:16:08.189478 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 13:16:08.189478 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 13:16:08.189478 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 13:16:08.189478 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 13:16:08.189478 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 13:16:08.189478 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 13:16:08.189478 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 13:16:08.189478 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 13:16:08.189478 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:16:08.189478 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 13:16:08.189478 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 13:16:08.189478 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 13 13:16:08.189478 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 13 13:16:08.189478 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:16:08.189478 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 13 13:16:08.189478 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:16:08.189478 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:16:08.189478 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:16:08.191087 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:16:08.191087 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:16:08.191087 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:16:08.191087 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:16:08.191087 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 13:16:08.191087 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 13:16:08.191087 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 13 13:16:08.191087 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 13 13:16:08.191087 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:16:08.191087 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 13 13:16:08.191087 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:16:08.191087 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:16:08.191087 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:16:08.191087 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:16:08.191087 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:16:08.191087 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 13 13:16:08.191087 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 13 13:16:08.191087 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-730da420-cb20-44f4-b3b2-4569bd2331f7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:16:08.193034 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-730da420-cb20-44f4-b3b2-4569bd2331f7 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012173 May 13 13:16:08.193034 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 27/52] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 13 13:16:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 13:16:09.083661 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-9b3dcf53-1848-4d4e-8117-cefe6a038521 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:16:09.084691 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-9b3dcf53-1848-4d4e-8117-cefe6a038521 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 13 13:16:09.085085 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 26/53] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 13 13:16:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:16:09.277087 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-61d6f34b-972e-4e25-9b1c-a39e3c4b91c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:16:09.369570 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-61d6f34b-972e-4e25-9b1c-a39e3c4b91c7 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.145045 May 13 13:16:09.370122 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 28/54] 10.222.0.13 () {64 vars in 1235 bytes} [Fri May 13 13:16:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:16:10.377745 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-9b3dcf53-1848-4d4e-8117-cefe6a038521 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:16:10.378850 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-9b3dcf53-1848-4d4e-8117-cefe6a038521 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 May 13 13:16:10.379249 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 27/55] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 13 13:16:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:16:10.589666 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-58f70c63-83f0-4287-954b-3fddb10c577f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:16:10.661603 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-58f70c63-83f0-4287-954b-3fddb10c577f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.141827 May 13 13:16:10.662189 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 29/56] 10.222.0.13 () {64 vars in 1235 bytes} [Fri May 13 13:16:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:16:11.610665 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-9b3dcf53-1848-4d4e-8117-cefe6a038521 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:16:11.612237 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-9b3dcf53-1848-4d4e-8117-cefe6a038521 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002441 May 13 13:16:11.613132 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 28/57] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 13 13:16:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:16:11.825235 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-4b142f92-e389-4f94-800c-6f2ec9c78538 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:16:11.975997 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-4b142f92-e389-4f94-800c-6f2ec9c78538 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.210635 May 13 13:16:11.976548 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 30/58] 10.222.0.13 () {64 vars in 1235 bytes} [Fri May 13 13:16:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:16:12.980331 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-9b3dcf53-1848-4d4e-8117-cefe6a038521 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:16:12.981369 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-9b3dcf53-1848-4d4e-8117-cefe6a038521 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 13 13:16:12.984048 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 29/59] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 13 13:16:12 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:16:13.179511 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-3e0bee43-f2a7-4e9a-959b-075e515edc9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:16:13.284493 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-3e0bee43-f2a7-4e9a-959b-075e515edc9e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.161172 May 13 13:16:13.285039 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 31/60] 10.222.0.13 () {64 vars in 1235 bytes} [Fri May 13 13:16:13 2022] POST /compute/v2.1/flavors => generated 409 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:16:14.221158 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-9b3dcf53-1848-4d4e-8117-cefe6a038521 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:16:14.222157 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-9b3dcf53-1848-4d4e-8117-cefe6a038521 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 May 13 13:16:14.222674 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 30/61] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 13 13:16:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:16:14.417321 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-8497c3a4-fc5d-433c-8c76-2cb4d3603fba admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:16:14.437094 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-8497c3a4-fc5d-433c-8c76-2cb4d3603fba admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072917 May 13 13:16:14.437553 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 32/62] 10.222.0.13 () {60 vars in 1202 bytes} [Fri May 13 13:16:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:17:17.849793 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-9b3dcf53-1848-4d4e-8117-cefe6a038521 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:17:17.850833 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-9b3dcf53-1848-4d4e-8117-cefe6a038521 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 13 13:17:17.851227 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 31/63] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 13 13:17:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:17:17.910370 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-85424b3e-21bf-4d4c-b5a0-18f1bc681dc4 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:17:17.929508 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-85424b3e-21bf-4d4c-b5a0-18f1bc681dc4 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072362 May 13 13:17:17.930086 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 33/64] 10.222.0.13 () {60 vars in 1291 bytes} [Fri May 13 13:17:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:17:17.952742 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-3fc9c9e2-805c-4658-882e-0a83630368c5 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:17:17.960569 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-3fc9c9e2-805c-4658-882e-0a83630368c5 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012388 May 13 13:17:17.961088 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 32/65] 10.222.0.13 () {60 vars in 1282 bytes} [Fri May 13 13:17:17 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:17:17.972853 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-35b0eafd-5eeb-4f39-9da4-f56dafec1698 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:17:17.980388 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-35b0eafd-5eeb-4f39-9da4-f56dafec1698 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011018 May 13 13:17:17.980968 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 34/66] 10.222.0.13 () {60 vars in 1285 bytes} [Fri May 13 13:17:17 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:17:17.992933 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-f0e712b8-290a-4906-aefe-a22815a8d807 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:17:18.000944 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-f0e712b8-290a-4906-aefe-a22815a8d807 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011642 May 13 13:17:18.001458 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 33/67] 10.222.0.13 () {60 vars in 1285 bytes} [Fri May 13 13:17:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:17:18.012593 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-bfb83a44-adb9-45d5-ad3d-57efa066b4ba admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:17:18.020324 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-bfb83a44-adb9-45d5-ad3d-57efa066b4ba admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011233 May 13 13:17:18.020847 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 35/68] 10.222.0.13 () {60 vars in 1282 bytes} [Fri May 13 13:17:18 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:20:55.592142 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-f0e712b8-290a-4906-aefe-a22815a8d807 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:20:55.593161 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-f0e712b8-290a-4906-aefe-a22815a8d807 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001632 May 13 13:20:55.593560 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 34/69] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 13 13:20:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:20:55.885007 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-f1358749-5731-4c11-bb27-37fa5443ba39 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:20:55.886251 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:20:55.886251 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: warnings.warn(msg) May 13 13:20:55.888007 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-f1358749-5731-4c11-bb27-37fa5443ba39 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:20:55.888449 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-f1358749-5731-4c11-bb27-37fa5443ba39 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:20:55.889274 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-f1358749-5731-4c11-bb27-37fa5443ba39 admin admin] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:20:55.889709 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-f1358749-5731-4c11-bb27-37fa5443ba39 admin admin] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:20:55.923518 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-f1358749-5731-4c11-bb27-37fa5443ba39 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.173287 May 13 13:20:55.924097 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 36/70] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 13 13:20:55 2022] GET /compute/v2.1/os-services => generated 791 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:20:56.845390 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-f0e712b8-290a-4906-aefe-a22815a8d807 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:20:56.846450 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-f0e712b8-290a-4906-aefe-a22815a8d807 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 May 13 13:20:56.846855 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 35/71] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 13 13:20:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:20:57.038656 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-49a7822b-aa28-4c65-9fbc-ecb37ebb7ac8 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:20:57.039850 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:20:57.039850 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: warnings.warn(msg) May 13 13:20:57.041034 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-49a7822b-aa28-4c65-9fbc-ecb37ebb7ac8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:20:57.041484 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-49a7822b-aa28-4c65-9fbc-ecb37ebb7ac8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:20:57.042360 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-49a7822b-aa28-4c65-9fbc-ecb37ebb7ac8 admin admin] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:20:57.042880 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-49a7822b-aa28-4c65-9fbc-ecb37ebb7ac8 admin admin] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:20:57.063481 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-49a7822b-aa28-4c65-9fbc-ecb37ebb7ac8 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077600 May 13 13:20:57.063975 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 37/72] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 13 13:20:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:21:08.370556 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-f0e712b8-290a-4906-aefe-a22815a8d807 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:21:08.371525 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-f0e712b8-290a-4906-aefe-a22815a8d807 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 May 13 13:21:08.371919 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 36/73] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 13 13:21:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:21:08.570218 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-32cc7ec6-684a-4749-bd62-22b1728c257a admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:21:08.571414 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:21:08.571414 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: warnings.warn(msg) May 13 13:21:08.572658 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-32cc7ec6-684a-4749-bd62-22b1728c257a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:21:08.573124 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-32cc7ec6-684a-4749-bd62-22b1728c257a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:21:08.573924 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-32cc7ec6-684a-4749-bd62-22b1728c257a admin admin] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:21:08.574456 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-32cc7ec6-684a-4749-bd62-22b1728c257a admin admin] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:21:08.599674 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-32cc7ec6-684a-4749-bd62-22b1728c257a admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082634 May 13 13:21:08.600316 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 38/74] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 13 13:21:08 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:21:09.524422 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-f0e712b8-290a-4906-aefe-a22815a8d807 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:21:09.525457 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-f0e712b8-290a-4906-aefe-a22815a8d807 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 May 13 13:21:09.525864 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 37/75] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 13 13:21:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:21:09.717784 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-93750bb4-2e9f-40f9-9161-8fb4605ae5bf admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:21:09.718985 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:21:09.718985 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: warnings.warn(msg) May 13 13:21:09.720155 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-93750bb4-2e9f-40f9-9161-8fb4605ae5bf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:21:09.720591 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-93750bb4-2e9f-40f9-9161-8fb4605ae5bf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:21:09.721398 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-93750bb4-2e9f-40f9-9161-8fb4605ae5bf admin admin] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:21:09.721826 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-93750bb4-2e9f-40f9-9161-8fb4605ae5bf admin admin] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:21:09.743879 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-93750bb4-2e9f-40f9-9161-8fb4605ae5bf admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078863 May 13 13:21:09.744345 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 39/76] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 13 13:21:09 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:22:07.348978 dv-cinder-841632-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 13 13:22:07.349588 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: Fri May 13 13:22:07 2022 - graceful shutdown triggered... May 13 13:22:07.350063 dv-cinder-841632-1-iscsi devstack@n-api.service[103314]: Gracefully killing worker 1 (pid: 103314)... May 13 13:22:07.350455 dv-cinder-841632-1-iscsi devstack@n-api.service[103315]: Gracefully killing worker 2 (pid: 103315)... May 13 13:22:08.350796 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: worker 1 buried after 1 seconds May 13 13:22:08.350796 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: worker 2 buried after 1 seconds May 13 13:22:08.351455 dv-cinder-841632-1-iscsi devstack@n-api.service[103313]: goodbye to uWSGI. May 13 13:22:08.352468 dv-cinder-841632-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 13 13:22:08.353047 dv-cinder-841632-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 13 13:22:08.355772 dv-cinder-841632-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 13 13:22:08.368530 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 13 13:22:08.387595 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 13 13:22:08 2022] *** May 13 13:22:08.387595 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 13 13:22:08.387595 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 13 13:22:08.387595 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: nodename: dv-cinder-841632-1-iscsi May 13 13:22:08.387595 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: machine: x86_64 May 13 13:22:08.387595 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: clock source: unix May 13 13:22:08.387595 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: pcre jit disabled May 13 13:22:08.387595 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: detected number of CPU cores: 4 May 13 13:22:08.387595 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: current working directory: / May 13 13:22:08.387595 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: detected binary path: /usr/bin/uwsgi-core May 13 13:22:08.387595 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: your processes number limit is 47680 May 13 13:22:08.387595 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: your memory page size is 4096 bytes May 13 13:22:08.387595 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: detected max file descriptor number: 2048 May 13 13:22:08.387595 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: lock engine: pthread robust mutexes May 13 13:22:08.388713 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: thunder lock: enabled May 13 13:22:08.388713 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 13 13:22:08.388713 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 13 13:22:08.434757 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: Python main interpreter initialized at 0x5641864869c0 May 13 13:22:08.434757 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: python threads support enabled May 13 13:22:08.434757 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: your server socket listen backlog is limited to 100 connections May 13 13:22:08.434757 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: your mercy for graceful operations on workers is 90 seconds May 13 13:22:08.435218 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: mapped 403077 bytes (393 KB) for 2 cores May 13 13:22:08.435218 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: *** Operational MODE: preforking *** May 13 13:22:08.435482 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: *** uWSGI is running in multiple interpreter mode *** May 13 13:22:08.435482 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: spawned uWSGI master process (pid: 117700) May 13 13:22:08.435704 dv-cinder-841632-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 13 13:22:08.436381 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: spawned uWSGI worker 1 (pid: 117720, cores: 1) May 13 13:22:08.439399 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: spawned uWSGI worker 2 (pid: 117721, cores: 1) May 13 13:22:08.439399 dv-cinder-841632-1-iscsi devstack@n-api.service[117700]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 13 13:22:09.677694 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 13:22:09.679615 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 13:22:10.497419 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:22:10.497419 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: from cryptography.utils import int_from_bytes May 13 13:22:10.497708 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:22:10.497708 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: from cryptography.utils import int_from_bytes May 13 13:22:10.498157 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:22:10.498157 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: from cryptography.utils import int_from_bytes May 13 13:22:10.498505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:22:10.498505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: from cryptography.utils import int_from_bytes May 13 13:22:12.965307 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 13:22:12.965867 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 13:22:12.966101 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 13:22:12.966502 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 13:22:12.966766 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 13:22:12.967154 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.967485 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.967815 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.968138 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.968475 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.968879 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.969198 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.969498 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.969828 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.970095 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.970444 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.970776 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841632-1-iscsi {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.971106 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.971422 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.971738 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.972066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.972380 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.972707 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.973020 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.973523 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.973970 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.974302 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.974624 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.975015 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.975285 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.975602 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.975924 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.976119 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 13:22:12.976520 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.976613 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 13:22:12.976803 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.976895 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.976986 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 13:22:12.977244 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 13:22:12.977347 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841632-1-iscsi {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.977511 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 13:22:12.977638 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.977872 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.977975 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.978193 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.978322 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.978533 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.978632 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.978850 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.978949 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.979180 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.979287 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.979490 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.979595 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.979814 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.979940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.980132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.980246 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.980456 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.980589 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.980750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.980860 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.981017 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.981124 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.981351 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841632-1-iscsi {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.981479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.981658 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.981768 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.981963 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.982076 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.982294 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.982407 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.982632 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.982748 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.982928 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.983041 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.983226 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.983325 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.983481 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.983583 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.983792 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.984016 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.984127 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.984354 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.984965 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.985066 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.985168 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.985268 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.985369 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.985464 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.985556 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.985659 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.985756 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.985870 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.985966 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.986160 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.986296 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.986490 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.986595 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.986812 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.986954 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.987120 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.987223 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.987427 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.987530 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841632-1-iscsi {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.987739 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.987840 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.988054 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.988197 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.988366 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.988486 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.988686 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.988788 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.989004 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.989109 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.989328 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.989428 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.989636 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.989736 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.989962 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.990081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.990339 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.990449 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.990632 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.990731 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.990946 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.991091 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.991289 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.991395 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.991614 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.991730 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.991924 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.992025 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.992247 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.992340 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.992575 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.992698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.992890 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.993054 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.993188 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.993290 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.993489 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.993597 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.993736 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.993836 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.994039 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.994139 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.994389 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.994499 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.994684 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.994785 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.994988 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.995091 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.995247 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.995340 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.995494 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.995589 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.995811 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.995912 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.996127 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.996287 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.996430 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.996529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.996732 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.996833 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.997034 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.997135 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.997473 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.997572 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.997666 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.997770 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.997913 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.998017 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.998233 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.998359 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.998541 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.998803 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.998904 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.998998 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.999156 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.999250 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.999461 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.999567 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.999762 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:12.999862 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.000646 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.000890 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.001298 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.001389 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.001481 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.001574 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.001667 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.001754 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.001850 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.001943 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.002149 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.002288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.002496 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.002659 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.002814 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.002909 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.003132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.003240 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.003436 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.003537 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.003737 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.003840 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.004039 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.004230 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.004372 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.004468 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.004663 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.004761 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.004964 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.005072 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.005212 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.005312 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.005508 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.005606 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.005809 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.005903 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.006123 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.006275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.006451 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.006545 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.006789 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.006893 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.007098 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.007192 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.007406 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.007508 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.007714 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.007814 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.008022 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.008115 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.008324 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.008428 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.008623 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.008771 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.008923 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.009015 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.009223 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.009444 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.009577 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.009716 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.009852 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.009949 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.010099 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.010230 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.010438 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.010543 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.010751 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.010852 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.011053 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.011158 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.011354 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.011479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.011653 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.011799 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.011953 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.012138 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.012269 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.012473 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.012579 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.012794 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.012894 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.013109 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.013208 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.013427 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.013521 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.013733 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.013832 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.014045 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.014143 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.014372 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.014520 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.014680 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.014780 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.014992 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.015084 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.015285 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.015379 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.016470 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.016593 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.016683 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.016775 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.016875 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.016962 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.017147 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.017299 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.017447 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.017555 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.017747 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.017852 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.018048 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.018181 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.018445 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.018569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.018744 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.018884 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.019043 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.019166 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.019339 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.019516 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.019655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.019834 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.019972 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.020164 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.020273 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.020491 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.020585 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.020807 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.020954 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.021122 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.021228 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:22:13.021438 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.021603 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.021765 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.021900 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.022101 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.022268 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.022444 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.022552 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.022767 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.022903 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.023085 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.023196 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.023400 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.023500 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.023713 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.023813 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.024026 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.024164 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.024342 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.024446 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.024682 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.024785 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.025000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.025093 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.025310 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.025402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.025623 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.025723 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.025934 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.026025 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.026272 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.026369 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.026587 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.026678 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.026901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.027015 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.027210 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.027348 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.027515 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.027608 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.027821 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.027926 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.028137 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.028271 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.028521 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.028667 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.028797 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.028939 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.029070 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.029167 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.029387 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.029516 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.029704 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.029827 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.030017 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.030120 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.030355 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.030470 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.030654 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.030751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.030960 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.031065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.031389 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.031923 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.032044 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.032133 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.032226 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.032320 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.032412 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.032606 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.032715 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.032924 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.033060 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.033232 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.033323 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.033557 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.033663 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.033864 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.033963 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.034168 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.034331 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.034499 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.034606 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.034825 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.034928 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.035137 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.035228 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.035449 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.035542 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.035756 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.035848 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.036070 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.036163 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.036379 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.036473 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.036687 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.036779 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.036993 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.037095 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.037294 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.037388 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.037595 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.037690 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.037956 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.038122 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.038310 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.038467 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.038631 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.038770 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.038942 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.039100 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.039257 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.039404 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.039568 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.039721 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.039877 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.040024 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.040185 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.040328 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.040496 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.040637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.040803 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.040944 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.041111 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.041249 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.041421 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.041551 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.041729 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.041856 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.042036 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.042162 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.042407 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.042502 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.042724 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.042826 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.043034 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.043172 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.043342 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.043444 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.043651 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.043753 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.043978 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.044070 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.044278 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.044378 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.044591 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.044691 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.044898 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.045000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.045205 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.045312 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.045513 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.045607 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.045821 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.045917 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.046140 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.046299 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.046476 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.046578 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.046921 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.052539 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.052539 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.052539 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.052798 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.052876 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.052974 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.053052 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.053052 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.053226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.053302 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.053383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.053463 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.053565 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.053657 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.053754 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.053893 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.054032 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.054182 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.054374 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.054507 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.054629 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.054629 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.054788 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.054886 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.054967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.055053 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.055135 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.055209 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.055287 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.055360 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.055360 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.055496 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.055569 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.055641 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.055719 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.055791 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.055862 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.055946 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.056026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.056098 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.056098 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.056226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.056305 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.056384 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.056457 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.056534 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.056606 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.056676 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.056758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.056832 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.056909 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.056988 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.057060 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.057151 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.057242 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.057322 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.057395 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.057466 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.057544 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.057647 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.057739 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.057819 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.057892 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.057963 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.058035 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.058119 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.058214 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.058303 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.058303 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.058443 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.058514 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.058596 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.058677 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.058756 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.058903 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.059003 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.059228 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.059346 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.059516 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.059611 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.059823 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.059922 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.060141 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.060315 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.060443 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.060542 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.060755 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.060854 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.061062 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.061156 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.061385 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.061519 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.061698 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.061807 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.062006 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.062102 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.062336 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.063006 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.063600 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.063722 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.063828 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.063924 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.064011 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.064103 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.064196 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.064325 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.064455 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.064648 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.064750 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.064957 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.065058 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.065268 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.065381 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.065576 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.065678 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.065893 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.066001 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.066209 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.066310 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.066531 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.066679 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.066823 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.066974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.067130 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.067269 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.067439 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.067591 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.067763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.067918 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.068068 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.068243 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.068425 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.068574 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.068712 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.068851 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.069012 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.069108 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.069452 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.069606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.069745 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.069901 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.070052 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.070214 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.070312 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.070431 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.070532 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.070737 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.070838 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.071050 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.071150 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.071358 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.071519 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.071670 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.071834 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.071983 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.072129 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.072281 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.072424 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.072581 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.072723 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.072863 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.073020 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.073164 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.073324 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.073463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.073600 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.073747 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.073881 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.074021 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.074350 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.074475 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.074673 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.074786 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.074982 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.075148 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.075307 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.075457 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.075599 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.075744 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.075892 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.076039 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.076188 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.076336 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.076476 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.076620 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.076767 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.076969 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.077113 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.077264 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.077418 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.077566 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.077706 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.077882 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.078122 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.078836 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.078937 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.079245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.079406 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.079557 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.079711 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.079814 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.079911 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.080095 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.080190 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.080410 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.080513 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.080721 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.080827 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.081029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.081129 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.081337 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.081429 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.081643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.081745 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.081999 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.082146 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.082312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.082693 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.082860 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.083029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.083148 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.083260 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.083463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.083568 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.083748 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.083922 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.084085 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.084231 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.084384 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.084551 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.084770 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.084911 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.085061 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.085208 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.085359 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.085608 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.085763 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.085919 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.086067 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.086262 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.086427 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.086583 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.086737 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.086882 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.087034 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.087174 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.087320 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.087504 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.087657 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.087800 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.087973 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.088110 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.088269 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.088412 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.088562 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.088731 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.088879 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.088971 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.089063 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.089282 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.089375 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.089593 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.089767 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.089898 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.090065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.090243 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.090354 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.090517 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.090696 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.090828 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.091134 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.091454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.091766 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.092075 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.092378 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.092691 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.092981 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.093135 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.093281 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.093482 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.093792 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.094508 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.094508 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.097552 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.097652 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.097652 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.097837 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.097934 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.098036 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.098461 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.098562 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.098669 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.098764 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.098859 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.098997 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.099094 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.099182 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.099281 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.099377 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.099471 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.099471 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.099627 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.099720 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.099865 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.099972 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.100115 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.100206 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.100290 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.100390 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.100508 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.100601 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.100694 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.100781 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.100865 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.101032 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.101121 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.101213 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.101306 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.101393 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.101485 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.101591 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.101591 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.101764 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.101850 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.101934 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.102026 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.102113 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.102229 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.102367 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.102456 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.102541 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.102638 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.102733 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.102819 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.102910 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.102997 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.103081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.103173 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.103267 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.103364 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.103450 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.103543 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.103637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.103802 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.103942 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.104139 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.104234 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.104440 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.104542 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.104761 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.104862 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.105072 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.105165 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.105373 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.105479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.105674 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.105804 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.105984 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.106078 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.106314 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.106425 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.109544 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.110074 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.111108 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.111211 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.111302 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.111402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.111500 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.111589 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.111681 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.111812 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.111906 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.112002 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.112097 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.112184 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.112268 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.112362 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.112458 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.112586 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.112679 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.112773 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.112773 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.112930 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.113028 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.113123 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.113209 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.113302 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.113396 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.113482 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.113575 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.113670 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.113757 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.113849 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.113936 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.114060 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.114233 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.114337 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.114425 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.114510 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.114595 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.114688 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.114782 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.114869 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.114961 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.115048 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.115132 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.115266 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.115360 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.115445 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.115531 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.115616 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.115708 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.115805 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.115930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.116030 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.116106 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.116191 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.116282 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.116377 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.116471 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.116564 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.116650 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.116742 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.116841 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.116928 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.117019 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.117106 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.117191 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.117282 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.117380 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.117473 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.117473 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.117644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.117738 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.117824 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.117916 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.118058 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.118302 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.118409 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.118610 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.118720 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.118924 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.119009 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.119242 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.119331 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.119551 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.119659 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.119857 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.119955 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.120170 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.120306 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.120474 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.120574 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.120789 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.120880 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.121100 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.121191 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.121415 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.121515 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.121718 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.121820 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.122022 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.122114 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.122368 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.122480 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.122682 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.122826 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.123001 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.123149 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.123303 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.123397 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.123626 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.123731 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.123933 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.124032 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.124237 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.124339 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.124548 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.124648 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.124855 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.125483 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.125789 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.125889 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.126183 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.126408 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.126522 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.126728 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.126833 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.127052 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.127144 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.127382 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.127473 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.127711 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.127805 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.128029 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.128133 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.128337 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.128467 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.128640 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.128737 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.128939 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.129038 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.129241 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.129341 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.129562 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.129673 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.129870 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.129970 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.130172 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.130332 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.130508 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.130602 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.130812 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.130912 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.131120 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.131220 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.131423 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.131514 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.131768 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.131985 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.132185 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.132296 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.132516 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.132615 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.132831 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.132923 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.133158 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.133263 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.133483 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.133581 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.133791 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.133890 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.134100 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.134251 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.134428 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.134527 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.134736 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.134871 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.135045 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.135173 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.135371 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.135478 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.135678 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.135781 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.135995 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.136094 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.136309 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.136403 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.136618 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.136710 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.136929 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.137029 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.137230 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.137320 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.137529 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.137622 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.137830 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.137921 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.138150 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.138275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.138479 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.138579 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.138799 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.138890 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.139124 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.139217 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.139437 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.139538 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.139762 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.139854 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.140075 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.140180 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.140383 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.140513 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.141376 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.141527 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.141699 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.142020 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.142147 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.142366 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.142672 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.142774 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.142987 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.143088 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.143294 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.143386 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.143616 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.143706 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.143940 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.144040 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.144249 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.144379 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.144563 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.144665 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.144866 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.144958 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.145185 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.145278 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.145504 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.145596 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.145816 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.145919 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.146134 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.146260 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.146476 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.146703 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.146813 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.147012 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.147104 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.147385 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.147477 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.147693 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.147793 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.148005 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.148097 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.148315 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.148447 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.148620 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.148756 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.148945 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.149230 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.149324 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.149538 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.149695 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.149846 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.149988 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.150135 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.150298 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.150478 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.150617 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.150788 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.150881 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.151093 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.151194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.151395 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.151565 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.151698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.151801 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.152017 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.152108 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.152319 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.152425 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.152642 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.152763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.152954 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.153076 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.153277 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.153436 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.153580 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.153728 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.153869 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.154010 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.154191 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.154316 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.154524 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.154624 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.154827 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.154921 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.155126 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.155219 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.155426 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.155518 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.155764 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.155865 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.156069 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.156162 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.156408 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.156744 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.156857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.157049 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.157163 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.157354 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.157447 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.157683 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.157783 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.158008 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.158274 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.158371 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.158612 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.158717 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.158938 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.159052 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.159249 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.159340 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.159549 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.159650 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.159854 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.159947 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.160156 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.160255 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.160505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.160605 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.160756 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.160853 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.161048 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.161139 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.161346 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.161437 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.161723 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.161831 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.161940 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.162040 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.162281 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.162390 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.162587 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.162679 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.162998 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.163097 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.163321 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.163462 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.163622 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.163720 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.163923 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.164016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.164223 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.164328 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.164568 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.164706 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.164872 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.164964 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.165200 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.165292 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.165514 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.165605 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.165832 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.165930 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.166148 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.166262 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.166490 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.166617 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.166810 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.166928 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.167126 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.167252 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.167436 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.167556 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.167748 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.167875 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.168057 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.168178 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.168683 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.168873 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.169098 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.169260 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.169408 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.169539 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.169661 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.169781 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.169892 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.170011 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.170122 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.170322 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.170438 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.170557 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.170738 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.170892 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.171064 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.171164 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.171376 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.171469 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.171686 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.171851 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.172068 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.172410 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.172623 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.172717 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.172813 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.172907 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.172993 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.173084 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.173397 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.173511 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.173652 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.173747 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.173949 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.174050 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.174285 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.174381 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.174595 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.174740 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.174921 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.175013 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.175234 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.175339 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.175543 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.175636 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.175868 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.175968 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.176179 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.176288 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.176492 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.176721 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.176849 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.177077 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.177178 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.177400 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.177499 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.177738 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.177838 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.178050 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.178158 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.178401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.178504 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.178710 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.178801 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.179022 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.179179 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.179333 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.179425 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.179641 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.179741 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.179946 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.180046 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.180254 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.180354 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.180559 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.180659 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.180863 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.180994 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.181167 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.181258 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.181478 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.181577 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.181782 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.181882 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.182093 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.182241 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.182425 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.182519 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.182736 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.182836 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.183051 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.183254 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.183355 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.183568 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.183661 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.183901 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.183999 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.184230 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.184330 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.184540 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.184639 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.184847 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.184946 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.185152 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.185251 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.185467 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.185561 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.185769 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.185859 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.186072 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.186240 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.186402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.186495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.186710 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.186808 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.187011 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.187126 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.187319 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.187934 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.188313 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.188405 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.191676 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.191856 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.191985 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.192109 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.192230 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.192387 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.192507 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.192627 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.192741 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.192741 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.192997 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.193109 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.193226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.193346 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.193458 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.193458 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.193716 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.193828 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.193947 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.194080 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.194223 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.194349 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.194483 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.194612 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.194612 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.194871 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.194989 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.195106 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.195217 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.195327 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.195445 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.195557 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.195673 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.195793 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.195904 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.196021 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.196145 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.196256 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.196373 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.196483 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.196600 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.196719 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.196830 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.196946 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.197057 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.197167 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.197282 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.197406 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.197518 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.197627 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.197743 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.197859 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.197971 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.198094 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.198252 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.198395 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.198532 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.198661 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.198803 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.198932 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.199067 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.199467 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.199601 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.199737 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.199880 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.199880 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.200130 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.200259 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.200386 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.200525 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.200664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.200794 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.200923 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.201053 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.201181 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.201309 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.201445 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.201575 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.202278 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.202412 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.202561 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.202700 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.202791 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.202875 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.202959 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.203642 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.203813 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.203970 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.204138 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.204309 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.204411 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.204556 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.204657 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.204791 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.204919 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.205056 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.205199 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.205330 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.205474 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.205474 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.205686 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.205792 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.205879 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.205972 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.206059 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.206151 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.206265 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.206354 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.206438 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.206536 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.206624 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.206716 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.206802 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.206961 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.207062 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.207295 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.207659 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.207901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.208001 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.208215 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.208350 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.208520 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.208663 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.208829 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.209121 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.209275 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.209427 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.209570 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.209710 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.209847 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.210061 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.210223 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.210469 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.210628 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.210781 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.210929 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.211066 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.211291 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.211440 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.211603 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.211739 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.211910 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.212001 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.212100 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.212263 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.212358 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.212577 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.212678 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.212885 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.212985 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.213191 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.213283 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.213498 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.213598 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.213804 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.213909 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.214109 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.214383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.214487 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.214582 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.214743 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.214836 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.215052 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.215145 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.215360 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.215451 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.215665 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.215803 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.215974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.216068 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.216280 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.216374 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.216616 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.216710 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.216954 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.217055 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.217271 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.217373 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.217600 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.217705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.217911 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.218005 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.218255 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.218396 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.218561 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.218679 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.218909 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.219016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.219349 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.219463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.219670 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.219784 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.219987 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.220102 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.220315 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.220452 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.220618 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.220727 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.220923 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.221025 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.221231 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.221355 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.221553 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.221668 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.221855 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.221977 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.222156 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.222295 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.222483 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.222576 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.222791 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.222884 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.223094 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.223189 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.223394 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.223497 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.223699 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.223877 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.224036 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.224183 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.224342 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.224492 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.224651 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.224800 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.224949 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.225100 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.225241 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.225379 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.225562 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.225713 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.225869 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.226007 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.226147 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.226307 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.226495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.226642 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.226790 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.226929 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.227090 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.227238 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.227392 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.227540 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.227678 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.227824 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.227970 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.228108 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.228284 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.228435 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.228618 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.228759 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.228932 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.229100 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.229260 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.229407 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.229549 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.229696 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.229843 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.230057 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.230256 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.230398 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.230564 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.230714 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.230812 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.230907 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.231089 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.231188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 13:22:13.231399 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.231728 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.232035 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.232347 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.232653 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.232963 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.233273 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.233581 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.233906 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.234774 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.235081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.235443 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.235718 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.236038 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.236352 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.236663 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.236988 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.237298 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.237606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.237919 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.238245 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.238557 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.238872 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.239182 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.239503 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.239828 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.240135 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.240452 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.240774 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.241242 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.241557 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.241903 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.242281 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.242560 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.242870 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.243173 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:22:13.243414 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 13:22:13.255959 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_db.sqlalchemy.engines [None req-ee423b29-49db-4ae6-b500-e091adb4c454 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:22:13.267503 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_db.sqlalchemy.engines [None req-f0f5a409-8b32-4432-a009-1af4391101ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:22:13.320425 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.context [None req-ee423b29-49db-4ae6-b500-e091adb4c454 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ed747a63-75f5-43f4-a721-9b3138eb67b0(cell1) {{(pid=117721) load_cells /opt/stack/nova/nova/context.py:464}} May 13 13:22:13.324818 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ee423b29-49db-4ae6-b500-e091adb4c454 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:22:13.326413 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ee423b29-49db-4ae6-b500-e091adb4c454 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:22:13.327216 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ee423b29-49db-4ae6-b500-e091adb4c454 None None] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:22:13.329798 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ee423b29-49db-4ae6-b500-e091adb4c454 None None] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:22:13.332102 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.context [None req-f0f5a409-8b32-4432-a009-1af4391101ca None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ed747a63-75f5-43f4-a721-9b3138eb67b0(cell1) {{(pid=117720) load_cells /opt/stack/nova/nova/context.py:464}} May 13 13:22:13.336738 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f0f5a409-8b32-4432-a009-1af4391101ca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:22:13.338343 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f0f5a409-8b32-4432-a009-1af4391101ca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:22:13.339161 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f0f5a409-8b32-4432-a009-1af4391101ca None None] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:22:13.341152 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f0f5a409-8b32-4432-a009-1af4391101ca None None] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:22:13.341593 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_db.sqlalchemy.engines [None req-ee423b29-49db-4ae6-b500-e091adb4c454 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:22:13.342886 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_db.sqlalchemy.engines [None req-ee423b29-49db-4ae6-b500-e091adb4c454 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:22:13.353677 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_db.sqlalchemy.engines [None req-f0f5a409-8b32-4432-a009-1af4391101ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:22:13.355128 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_db.sqlalchemy.engines [None req-f0f5a409-8b32-4432-a009-1af4391101ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:22:13.506096 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_db.sqlalchemy.engines [None req-ee423b29-49db-4ae6-b500-e091adb4c454 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:22:13.521526 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_db.sqlalchemy.engines [None req-f0f5a409-8b32-4432-a009-1af4391101ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:22:13.838846 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: WARNING keystonemiddleware.auth_token [None req-ee423b29-49db-4ae6-b500-e091adb4c454 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:22:13.845936 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: WARNING keystonemiddleware.auth_token [None req-f0f5a409-8b32-4432-a009-1af4391101ca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:22:13.847890 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: WARNING keystonemiddleware.auth_token [None req-ee423b29-49db-4ae6-b500-e091adb4c454 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:22:13.854062 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: WARNING keystonemiddleware.auth_token [None req-f0f5a409-8b32-4432-a009-1af4391101ca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:22:14.201744 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: WARNING keystonemiddleware.auth_token [None req-f0f5a409-8b32-4432-a009-1af4391101ca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:22:14.205531 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: WARNING keystonemiddleware.auth_token [None req-ee423b29-49db-4ae6-b500-e091adb4c454 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:22:14.208452 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: WARNING keystonemiddleware.auth_token [None req-f0f5a409-8b32-4432-a009-1af4391101ca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:22:14.212521 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: WARNING keystonemiddleware.auth_token [None req-ee423b29-49db-4ae6-b500-e091adb4c454 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:22:14.213754 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5641864869c0 pid: 117720 (default app) May 13 13:22:14.217791 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5641864869c0 pid: 117721 (default app) May 13 13:22:58.426739 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a3055d20-5ec4-4d10-ab7f-21153d303f5b tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Action: 'create', calling method: .version_select at 0x7fb08624f280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-436723939"}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:22:58.568367 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2fbbe95f-bd97-4998-8265-5ef71eeae11d tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] Action: 'create', calling method: .version_select at 0x7fb08624f280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-939814901", "metadata": {"Type": "work"}}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:22:58.595930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2fbbe95f-bd97-4998-8265-5ef71eeae11d tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] Request method failure captured: May 13 13:22:58.595930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 13 13:22:58.595930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:22:58.595930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:22:58.595930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:22:58.595930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 121 May 13 13:22:58.595930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:22:58.595930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:22:58.595930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:22:58.595930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:22:58.595930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABifluxBeCmx3WgoL-Olh7k8mUBg-vFsbEw7lqWVHePjq6GcIJYsDkBxn-9-hN1I8cmPf5P_Prrh_91XQeamL8YOneLXiKc0zHaFjPvpRHVA_DDNvdPURkzzeXTfYcQSHGc9bfPFBjFELCmLhcg8dY9SGOKJi7Upw-djSD1tubalCWGKY0 May 13 13:22:58.595930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:22:58.595930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:22:58.595930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:22:58.595930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:22:58.595930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:22:58.595930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:22:58.595930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: c8561e4e6ecb48118b4addb705120ef0 May 13 13:22:58.595930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-VolumesNegativeTest-1799084043 May 13 13:22:58.595930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:22:58.595930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:22:58.597602 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c8561e4e6ecb48118b4addb705120ef0", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8561e4e6ecb48118b4addb705120ef0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c8561e4e6ecb48118b4addb705120ef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8561e4e6ecb48118b4addb705120ef0"}]}] May 13 13:22:58.597602 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-VolumesNegativeTest-1799084043 May 13 13:22:58.597602 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: c8561e4e6ecb48118b4addb705120ef0 May 13 13:22:58.597602 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-VolumesNegativeTest-1799084043 May 13 13:22:58.597602 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-VolumesNegativeTest-1799084043-project May 13 13:22:58.597602 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:22:58.597602 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:22:58.597602 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: 5fbb912e7b38452f86d3ee413b7da3e3 May 13 13:22:58.597602 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-VolumesNegativeTest-1799084043-project May 13 13:22:58.597602 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: May 13 13:22:58.597602 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-939814901", "metadata": {"Type": "work"}}} May 13 13:22:58.597602 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: May 13 13:22:58.597602 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 13 13:22:58.599613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-939814901', 'metadata': {'Type': 'work'}}}} May 13 13:22:58.599613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:22:58.599613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:22:58.599613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 13 13:22:58.599613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 13 13:22:58.599613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 13 13:22:58.599613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise error May 13 13:22:58.599613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 13 13:22:58.599613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:58.599613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 13 13:22:58.599613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 13 13:22:58.599613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:58.599613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi On instance['volume']: May 13 13:22:58.599613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi '#$%' May 13 13:22:58.599613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:58.599613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:22:58.599613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:58.599613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:22:58.599613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:22:58.599613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:22:58.599613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:22:58.599613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:22:58.602123 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:22:58.602123 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:22:58.602123 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:22:58.602123 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:22:58.602123 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 13 13:22:58.602123 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 13 13:22:58.602123 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 13 13:22:58.602123 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 13 13:22:58.602123 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 13 13:22:58.602123 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 13 13:22:58.602123 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 13 13:22:58.602123 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:58.602123 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:22:58.602123 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:58.602123 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:22:58.602123 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:22:58.602123 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:22:58.602123 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 13 13:22:58.602123 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 13 13:22:58.604869 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 13 13:22:58.604869 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:58.607721 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2fbbe95f-bd97-4998-8265-5ef71eeae11d tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:22:58.611077 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2fbbe95f-bd97-4998-8265-5ef71eeae11d tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.263724 May 13 13:22:58.623485 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 1/1] 10.222.0.13 () {60 vars in 1155 bytes} [Fri May 13 13:22:57 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1278 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 13:22:58.649209 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-aec781bc-394b-4516-88ed-5039e394efed tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] Action: 'create', calling method: .version_select at 0x7fb0860e25e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-467026013", "metadata": {"Type": "work"}}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:22:58.656877 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-aec781bc-394b-4516-88ed-5039e394efed tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] Request method failure captured: May 13 13:22:58.656877 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 13 13:22:58.656877 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:22:58.656877 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:22:58.656877 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:22:58.656877 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 119 May 13 13:22:58.656877 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:22:58.656877 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:22:58.656877 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:22:58.656877 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:22:58.656877 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABifluxBeCmx3WgoL-Olh7k8mUBg-vFsbEw7lqWVHePjq6GcIJYsDkBxn-9-hN1I8cmPf5P_Prrh_91XQeamL8YOneLXiKc0zHaFjPvpRHVA_DDNvdPURkzzeXTfYcQSHGc9bfPFBjFELCmLhcg8dY9SGOKJi7Upw-djSD1tubalCWGKY0 May 13 13:22:58.656877 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:22:58.656877 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:22:58.656877 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:22:58.656877 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:22:58.656877 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:22:58.656877 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:22:58.656877 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: c8561e4e6ecb48118b4addb705120ef0 May 13 13:22:58.656877 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-VolumesNegativeTest-1799084043 May 13 13:22:58.656877 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:22:58.656877 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:22:58.658518 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c8561e4e6ecb48118b4addb705120ef0", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8561e4e6ecb48118b4addb705120ef0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c8561e4e6ecb48118b4addb705120ef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8561e4e6ecb48118b4addb705120ef0"}]}] May 13 13:22:58.658518 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-VolumesNegativeTest-1799084043 May 13 13:22:58.658518 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: c8561e4e6ecb48118b4addb705120ef0 May 13 13:22:58.658518 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-VolumesNegativeTest-1799084043 May 13 13:22:58.658518 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-VolumesNegativeTest-1799084043-project May 13 13:22:58.658518 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:22:58.658518 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:22:58.658518 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: 5fbb912e7b38452f86d3ee413b7da3e3 May 13 13:22:58.658518 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-VolumesNegativeTest-1799084043-project May 13 13:22:58.658518 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: May 13 13:22:58.658518 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-467026013", "metadata": {"Type": "work"}}} May 13 13:22:58.658518 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: May 13 13:22:58.658518 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 13 13:22:58.659454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-467026013', 'metadata': {'Type': 'work'}}}} May 13 13:22:58.659454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:22:58.659454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:22:58.659454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 13 13:22:58.659454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 13 13:22:58.659454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 13 13:22:58.659454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise error May 13 13:22:58.659454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 13 13:22:58.659454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:58.659454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 13 13:22:58.659454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 13 13:22:58.659454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:58.659454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi On instance['volume']: May 13 13:22:58.659454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi '0' May 13 13:22:58.659454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:58.659454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:22:58.659454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:58.659454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:22:58.659454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:22:58.659454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:22:58.659454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:22:58.659454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:22:58.664032 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:22:58.664032 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:22:58.664032 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:22:58.664032 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:22:58.664032 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 13 13:22:58.664032 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 13 13:22:58.664032 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 13 13:22:58.664032 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 13 13:22:58.664032 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 13 13:22:58.664032 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 13 13:22:58.664032 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 13 13:22:58.664032 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:58.664032 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:22:58.664032 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:58.664032 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:22:58.664032 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:22:58.664032 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:22:58.664032 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 13 13:22:58.664032 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 13 13:22:58.670820 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 13 13:22:58.670820 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:58.670820 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-aec781bc-394b-4516-88ed-5039e394efed tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:22:58.673173 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-aec781bc-394b-4516-88ed-5039e394efed tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.043567 May 13 13:22:58.682592 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 2/2] 10.222.0.13 () {60 vars in 1155 bytes} [Fri May 13 13:22:58 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 13:22:58.691373 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8c716972-c839-4c4e-a313-07ef9642e4fd tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] Action: 'create', calling method: .version_select at 0x7fb08624f5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1335538978", "metadata": {"Type": "work"}}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:22:58.696884 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8c716972-c839-4c4e-a313-07ef9642e4fd tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] Request method failure captured: May 13 13:22:58.696884 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 13 13:22:58.696884 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:22:58.696884 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:22:58.696884 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:22:58.696884 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 119 May 13 13:22:58.696884 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:22:58.696884 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:22:58.696884 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:22:58.696884 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:22:58.696884 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABifluxBeCmx3WgoL-Olh7k8mUBg-vFsbEw7lqWVHePjq6GcIJYsDkBxn-9-hN1I8cmPf5P_Prrh_91XQeamL8YOneLXiKc0zHaFjPvpRHVA_DDNvdPURkzzeXTfYcQSHGc9bfPFBjFELCmLhcg8dY9SGOKJi7Upw-djSD1tubalCWGKY0 May 13 13:22:58.696884 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:22:58.696884 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:22:58.696884 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:22:58.696884 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:22:58.696884 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:22:58.696884 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:22:58.696884 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: c8561e4e6ecb48118b4addb705120ef0 May 13 13:22:58.696884 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-VolumesNegativeTest-1799084043 May 13 13:22:58.696884 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:22:58.696884 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:22:58.704672 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c8561e4e6ecb48118b4addb705120ef0", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8561e4e6ecb48118b4addb705120ef0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c8561e4e6ecb48118b4addb705120ef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8561e4e6ecb48118b4addb705120ef0"}]}] May 13 13:22:58.704672 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-VolumesNegativeTest-1799084043 May 13 13:22:58.704672 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: c8561e4e6ecb48118b4addb705120ef0 May 13 13:22:58.704672 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-VolumesNegativeTest-1799084043 May 13 13:22:58.704672 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-VolumesNegativeTest-1799084043-project May 13 13:22:58.704672 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:22:58.704672 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:22:58.704672 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: 5fbb912e7b38452f86d3ee413b7da3e3 May 13 13:22:58.704672 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-VolumesNegativeTest-1799084043-project May 13 13:22:58.704672 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: May 13 13:22:58.704672 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1335538978", "metadata": {"Type": "work"}}} May 13 13:22:58.704672 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: May 13 13:22:58.704672 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 13 13:22:58.706643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1335538978', 'metadata': {'Type': 'work'}}}} May 13 13:22:58.706643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:22:58.706643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:22:58.706643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 13 13:22:58.706643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 13 13:22:58.706643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 13 13:22:58.706643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise error May 13 13:22:58.706643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 13 13:22:58.706643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:58.706643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 13 13:22:58.706643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 13 13:22:58.706643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:58.706643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi On instance['volume']: May 13 13:22:58.706643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi '' May 13 13:22:58.706643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:58.706643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:22:58.706643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:58.706643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:22:58.706643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:22:58.706643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:22:58.706643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:22:58.706643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:22:58.709763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:22:58.709763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:22:58.709763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:22:58.709763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:22:58.709763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 13 13:22:58.709763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 13 13:22:58.709763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 13 13:22:58.709763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 13 13:22:58.709763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 13 13:22:58.709763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 13 13:22:58.709763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 13 13:22:58.709763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:58.709763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:22:58.709763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:58.709763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:22:58.709763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:22:58.709763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:22:58.709763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 13 13:22:58.709763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 13 13:22:58.711197 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 13 13:22:58.711197 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:58.711197 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8c716972-c839-4c4e-a313-07ef9642e4fd tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:22:58.711197 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8c716972-c839-4c4e-a313-07ef9642e4fd tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011959 May 13 13:22:58.713274 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 3/3] 10.222.0.13 () {60 vars in 1155 bytes} [Fri May 13 13:22:58 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 13:22:58.718381 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b73dcd8d-e2d6-48af-87f6-64cce0ffe62b tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] Calling method '.version_select at 0x7fb086101310>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:22:59.531955 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-b73dcd8d-e2d6-48af-87f6-64cce0ffe62b tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] HTTP exception thrown: Volume tempest-invalid-2100033779 could not be found. May 13 13:22:59.535913 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b73dcd8d-e2d6-48af-87f6-64cce0ffe62b tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] Request method failure captured: May 13 13:22:59.535913 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2100033779 HTTP/1.1 May 13 13:22:59.535913 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:22:59.535913 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:22:59.535913 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:22:59.535913 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:22:59.535913 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:22:59.535913 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:22:59.535913 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:22:59.535913 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:22:59.535913 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABifluxBeCmx3WgoL-Olh7k8mUBg-vFsbEw7lqWVHePjq6GcIJYsDkBxn-9-hN1I8cmPf5P_Prrh_91XQeamL8YOneLXiKc0zHaFjPvpRHVA_DDNvdPURkzzeXTfYcQSHGc9bfPFBjFELCmLhcg8dY9SGOKJi7Upw-djSD1tubalCWGKY0 May 13 13:22:59.535913 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:22:59.535913 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:22:59.535913 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:22:59.535913 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:22:59.535913 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:22:59.535913 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:22:59.535913 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: c8561e4e6ecb48118b4addb705120ef0 May 13 13:22:59.535913 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-VolumesNegativeTest-1799084043 May 13 13:22:59.535913 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:22:59.535913 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:22:59.537427 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c8561e4e6ecb48118b4addb705120ef0", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8561e4e6ecb48118b4addb705120ef0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c8561e4e6ecb48118b4addb705120ef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8561e4e6ecb48118b4addb705120ef0"}]}] May 13 13:22:59.537427 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-VolumesNegativeTest-1799084043 May 13 13:22:59.537427 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: c8561e4e6ecb48118b4addb705120ef0 May 13 13:22:59.537427 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-VolumesNegativeTest-1799084043 May 13 13:22:59.537427 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-VolumesNegativeTest-1799084043-project May 13 13:22:59.537427 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:22:59.537427 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:22:59.537427 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: 5fbb912e7b38452f86d3ee413b7da3e3 May 13 13:22:59.537427 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-VolumesNegativeTest-1799084043-project May 13 13:22:59.537427 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: May 13 13:22:59.537427 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Volume tempest-invalid-2100033779 could not be found. May 13 13:22:59.537427 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': 'tempest-invalid-2100033779'} May 13 13:22:59.537427 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:22:59.538401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:22:59.538401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:22:59.538401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:22:59.538401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 13:22:59.538401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 13:22:59.538401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 13:22:59.538401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 13:22:59.538401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 13:22:59.538401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 13:22:59.538401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 13:22:59.538401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 13:22:59.538401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:22:59.538401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:22:59.538401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:22:59.538401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:22:59.538401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2100033779 could not be found. (HTTP 404) (Request-ID: req-e5cbc282-3914-4066-aaca-5d5300f0f58f) May 13 13:22:59.538401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:59.538401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:22:59.538401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:59.539940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:22:59.539940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 13 13:22:59.539940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 13 13:22:59.539940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 13:22:59.539940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 13:22:59.539940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 13:22:59.539940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 13:22:59.539940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 13:22:59.539940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 13:22:59.539940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:22:59.539940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:22:59.539940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 13:22:59.539940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 13:22:59.539940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 13:22:59.539940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 13:22:59.539940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 13:22:59.539940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 13:22:59.539940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 13:22:59.539940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 13:22:59.541257 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:22:59.541257 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:22:59.541257 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:22:59.541257 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:22:59.541257 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2100033779 could not be found. May 13 13:22:59.541257 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:59.541257 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:22:59.541257 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:59.541257 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:22:59.541257 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:22:59.541257 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:22:59.541257 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:22:59.541257 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:22:59.541257 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:22:59.541257 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:22:59.541257 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:22:59.541257 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:22:59.541257 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 13 13:22:59.541257 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:22:59.541257 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2100033779 could not be found. May 13 13:22:59.542738 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:59.542738 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:22:59.542738 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:59.542738 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:22:59.542738 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:22:59.542738 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:22:59.542738 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:22:59.542738 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:22:59.542738 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2100033779 could not be found. May 13 13:22:59.542738 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:59.542738 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b73dcd8d-e2d6-48af-87f6-64cce0ffe62b tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] Returning 404 to user: Volume tempest-invalid-2100033779 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:22:59.544229 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b73dcd8d-e2d6-48af-87f6-64cce0ffe62b tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2100033779" status: 404 len: 99 microversion: 2.1 time: 0.830893 May 13 13:22:59.551925 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 4/4] 10.222.0.13 () {58 vars in 1217 bytes} [Fri May 13 13:22:58 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2100033779 => generated 99 bytes in 839 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 13 13:22:59.560746 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f51fb89b-7763-4684-a14d-89f81d4a11c9 tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007316 May 13 13:22:59.563262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 5/5] 10.222.0.13 () {58 vars in 1139 bytes} [Fri May 13 13:22:59 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 13 13:22:59.586109 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d51afdd8-d727-4db2-838b-c533a5b5e200 tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015774 May 13 13:22:59.592449 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 6/6] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 13 13:22:59 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 13 13:22:59.608907 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-07d6c03c-c895-4c1e-b917-bf0c18b52992 tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] Calling method '.version_select at 0x7fb08602a160>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:22:59.738103 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-07d6c03c-c895-4c1e-b917-bf0c18b52992 tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] HTTP exception thrown: Volume 3648e6a2-876e-4904-9a02-87aa066c7925 could not be found. May 13 13:22:59.741479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-07d6c03c-c895-4c1e-b917-bf0c18b52992 tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] Request method failure captured: May 13 13:22:59.741479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: DELETE /compute/v2.1/os-volumes/3648e6a2-876e-4904-9a02-87aa066c7925 HTTP/1.1 May 13 13:22:59.741479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:22:59.741479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:22:59.741479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:22:59.741479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:22:59.741479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:22:59.741479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:22:59.741479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:22:59.741479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:22:59.741479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABifluxBeCmx3WgoL-Olh7k8mUBg-vFsbEw7lqWVHePjq6GcIJYsDkBxn-9-hN1I8cmPf5P_Prrh_91XQeamL8YOneLXiKc0zHaFjPvpRHVA_DDNvdPURkzzeXTfYcQSHGc9bfPFBjFELCmLhcg8dY9SGOKJi7Upw-djSD1tubalCWGKY0 May 13 13:22:59.741479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:22:59.741479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:22:59.741479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:22:59.741479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:22:59.741479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:22:59.741479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:22:59.741479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: c8561e4e6ecb48118b4addb705120ef0 May 13 13:22:59.741479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-VolumesNegativeTest-1799084043 May 13 13:22:59.741479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:22:59.741479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:22:59.743155 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c8561e4e6ecb48118b4addb705120ef0", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8561e4e6ecb48118b4addb705120ef0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c8561e4e6ecb48118b4addb705120ef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8561e4e6ecb48118b4addb705120ef0"}]}] May 13 13:22:59.743155 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-VolumesNegativeTest-1799084043 May 13 13:22:59.743155 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: c8561e4e6ecb48118b4addb705120ef0 May 13 13:22:59.743155 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-VolumesNegativeTest-1799084043 May 13 13:22:59.743155 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-VolumesNegativeTest-1799084043-project May 13 13:22:59.743155 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:22:59.743155 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:22:59.743155 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: 5fbb912e7b38452f86d3ee413b7da3e3 May 13 13:22:59.743155 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-VolumesNegativeTest-1799084043-project May 13 13:22:59.743155 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: May 13 13:22:59.743155 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Volume 3648e6a2-876e-4904-9a02-87aa066c7925 could not be found. May 13 13:22:59.743155 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': '3648e6a2-876e-4904-9a02-87aa066c7925'} May 13 13:22:59.743155 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:22:59.744097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:22:59.744097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:22:59.744097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:22:59.744097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 13:22:59.744097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 13:22:59.744097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 13:22:59.744097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 13:22:59.744097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 13:22:59.744097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 13:22:59.744097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 13:22:59.744097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 13:22:59.744097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:22:59.744097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:22:59.744097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:22:59.744097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:22:59.744097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3648e6a2-876e-4904-9a02-87aa066c7925 could not be found. (HTTP 404) (Request-ID: req-f83d4517-3382-47dc-855b-c76c36e8e9dd) May 13 13:22:59.744097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:59.744097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:22:59.744097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:59.745430 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:22:59.745430 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 13 13:22:59.745430 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 13 13:22:59.745430 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 13:22:59.745430 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 13:22:59.745430 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 13:22:59.745430 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 13:22:59.745430 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 13:22:59.745430 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 13:22:59.745430 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:22:59.745430 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:22:59.745430 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 13:22:59.745430 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 13:22:59.745430 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 13:22:59.745430 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 13:22:59.745430 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 13:22:59.745430 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 13:22:59.745430 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 13:22:59.745430 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 13:22:59.748287 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:22:59.748287 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:22:59.748287 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:22:59.748287 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:22:59.748287 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3648e6a2-876e-4904-9a02-87aa066c7925 could not be found. May 13 13:22:59.748287 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:59.748287 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:22:59.748287 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:59.748287 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:22:59.748287 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:22:59.748287 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:22:59.748287 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:22:59.748287 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:22:59.748287 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:22:59.748287 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:22:59.748287 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:22:59.748287 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:22:59.748287 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 13 13:22:59.748287 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:22:59.750961 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3648e6a2-876e-4904-9a02-87aa066c7925 could not be found. May 13 13:22:59.750961 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:59.750961 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:22:59.750961 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:59.750961 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:22:59.750961 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:22:59.750961 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:22:59.750961 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:22:59.750961 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:22:59.750961 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3648e6a2-876e-4904-9a02-87aa066c7925 could not be found. May 13 13:22:59.750961 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:22:59.750961 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-07d6c03c-c895-4c1e-b917-bf0c18b52992 tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] Returning 404 to user: Volume 3648e6a2-876e-4904-9a02-87aa066c7925 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:22:59.750961 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-07d6c03c-c895-4c1e-b917-bf0c18b52992 tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/3648e6a2-876e-4904-9a02-87aa066c7925" status: 404 len: 109 microversion: 2.1 time: 0.148982 May 13 13:22:59.750961 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 7/7] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 13 13:22:59 2022] DELETE /compute/v2.1/os-volumes/3648e6a2-876e-4904-9a02-87aa066c7925 => generated 109 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:22:59.767988 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5efa6a81-4888-401b-b8e5-d7fae4bad560 tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] Calling method '.version_select at 0x7fb08602a280>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:00.273459 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-5efa6a81-4888-401b-b8e5-d7fae4bad560 tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] HTTP exception thrown: Volume 50021102-478c-4a9d-ab00-29a20106770c could not be found. May 13 13:23:00.275705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5efa6a81-4888-401b-b8e5-d7fae4bad560 tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] Request method failure captured: May 13 13:23:00.275705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/os-volumes/50021102-478c-4a9d-ab00-29a20106770c HTTP/1.1 May 13 13:23:00.275705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:23:00.275705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:23:00.275705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:23:00.275705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:23:00.275705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:23:00.275705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:23:00.275705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:23:00.275705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:23:00.275705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABifluxBeCmx3WgoL-Olh7k8mUBg-vFsbEw7lqWVHePjq6GcIJYsDkBxn-9-hN1I8cmPf5P_Prrh_91XQeamL8YOneLXiKc0zHaFjPvpRHVA_DDNvdPURkzzeXTfYcQSHGc9bfPFBjFELCmLhcg8dY9SGOKJi7Upw-djSD1tubalCWGKY0 May 13 13:23:00.275705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:23:00.275705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:23:00.275705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:23:00.275705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:23:00.275705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:23:00.275705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:23:00.275705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: c8561e4e6ecb48118b4addb705120ef0 May 13 13:23:00.275705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-VolumesNegativeTest-1799084043 May 13 13:23:00.275705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:23:00.275705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:23:00.277292 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c8561e4e6ecb48118b4addb705120ef0", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8561e4e6ecb48118b4addb705120ef0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c8561e4e6ecb48118b4addb705120ef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8561e4e6ecb48118b4addb705120ef0"}]}] May 13 13:23:00.277292 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-VolumesNegativeTest-1799084043 May 13 13:23:00.277292 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: c8561e4e6ecb48118b4addb705120ef0 May 13 13:23:00.277292 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-VolumesNegativeTest-1799084043 May 13 13:23:00.277292 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-VolumesNegativeTest-1799084043-project May 13 13:23:00.277292 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:23:00.277292 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:23:00.277292 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: 5fbb912e7b38452f86d3ee413b7da3e3 May 13 13:23:00.277292 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-VolumesNegativeTest-1799084043-project May 13 13:23:00.277292 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: May 13 13:23:00.277292 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Volume 50021102-478c-4a9d-ab00-29a20106770c could not be found. May 13 13:23:00.277292 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': '50021102-478c-4a9d-ab00-29a20106770c'} May 13 13:23:00.277292 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:23:00.278249 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:23:00.278249 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:23:00.278249 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:23:00.278249 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 13:23:00.278249 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 13:23:00.278249 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 13:23:00.278249 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 13:23:00.278249 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:23:00.278249 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:23:00.278249 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:23:00.278249 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:23:00.278249 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:23:00.278249 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:23:00.278249 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:23:00.278249 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:23:00.278249 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 50021102-478c-4a9d-ab00-29a20106770c could not be found. (HTTP 404) (Request-ID: req-2667770a-e6f8-4588-b270-42b1c607c19b) May 13 13:23:00.278249 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:23:00.278249 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:23:00.278249 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:23:00.279628 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:23:00.279628 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 13:23:00.279628 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 13:23:00.279628 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 13:23:00.279628 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 13:23:00.279628 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 13:23:00.279628 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 13:23:00.279628 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 13:23:00.279628 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 13:23:00.279628 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:23:00.279628 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:23:00.279628 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 13:23:00.279628 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 13:23:00.279628 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 13:23:00.279628 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 13:23:00.279628 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:23:00.279628 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:23:00.279628 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:23:00.279628 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:23:00.282035 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:23:00.282035 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:23:00.282035 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:23:00.282035 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:23:00.282035 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 50021102-478c-4a9d-ab00-29a20106770c could not be found. May 13 13:23:00.282035 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:23:00.282035 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:23:00.282035 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:23:00.282035 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:23:00.282035 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:23:00.282035 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:23:00.282035 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:23:00.282035 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:23:00.282035 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:23:00.282035 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:23:00.282035 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:23:00.282035 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:23:00.282035 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 13:23:00.282035 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:23:00.283351 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 50021102-478c-4a9d-ab00-29a20106770c could not be found. May 13 13:23:00.283351 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:23:00.283351 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:23:00.283351 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:23:00.283351 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:23:00.283351 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:23:00.283351 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:23:00.283351 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:23:00.283351 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:23:00.283351 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 50021102-478c-4a9d-ab00-29a20106770c could not be found. May 13 13:23:00.283351 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:23:00.283351 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5efa6a81-4888-401b-b8e5-d7fae4bad560 tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] Returning 404 to user: Volume 50021102-478c-4a9d-ab00-29a20106770c could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:23:00.285382 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5efa6a81-4888-401b-b8e5-d7fae4bad560 tempest-VolumesNegativeTest-1799084043 tempest-VolumesNegativeTest-1799084043-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/50021102-478c-4a9d-ab00-29a20106770c" status: 404 len: 109 microversion: 2.1 time: 0.533635 May 13 13:23:00.286396 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 8/8] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 13 13:22:59 2022] GET /compute/v2.1/os-volumes/50021102-478c-4a9d-ab00-29a20106770c => generated 109 bytes in 537 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:23:00.415526 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a3055d20-5ec4-4d10-ab7f-21153d303f5b tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.600902 May 13 13:23:00.416227 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 1/9] 10.222.0.13 () {60 vars in 1154 bytes} [Fri May 13 13:22:56 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3604 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 13 13:23:00.432164 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-99a204ed-5e76-4acf-bda1-89e89593a72a tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Calling method '.version_select at 0x7fb08608caf0>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:00.547930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-99a204ed-5e76-4acf-bda1-89e89593a72a tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/291e31e8-10fe-4fa4-aa1e-fc7c08b75712" status: 200 len: 344 microversion: 2.1 time: 0.123320 May 13 13:23:00.548811 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 9/10] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 13 13:23:00 2022] GET /compute/v2.1/os-volumes/291e31e8-10fe-4fa4-aa1e-fc7c08b75712 => generated 344 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:00.951280 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-48ea3a1e-e09b-4e0d-a4d6-7b4d9f8a0217 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1018219752", "imageRef": "ece294e8-5415-4d6a-a0d3-a14539c51c0a", "flavorRef": "452", "networks": [{"uuid": "21e00451-23e6-47b8-9a7d-43a8afdd14b9"}]}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:23:01.217132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.network.neutron [None req-48ea3a1e-e09b-4e0d-a4d6-7b4d9f8a0217 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] validate_networks() for [('21e00451-23e6-47b8-9a7d-43a8afdd14b9', None, None, None, None, None)] {{(pid=117720) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:23:01.572232 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-388cd507-c810-49cf-a7d7-b25cfea4fd0e tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Calling method '.version_select at 0x7fb08602a430>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:01.675993 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-388cd507-c810-49cf-a7d7-b25cfea4fd0e tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/291e31e8-10fe-4fa4-aa1e-fc7c08b75712" status: 200 len: 344 microversion: 2.1 time: 0.119153 May 13 13:23:01.677853 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 10/11] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 13 13:23:01 2022] GET /compute/v2.1/os-volumes/291e31e8-10fe-4fa4-aa1e-fc7c08b75712 => generated 344 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:02.690091 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f4dc3ae4-7957-4af4-94c8-d66ddf418427 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Calling method '.version_select at 0x7fb086045280>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:02.780734 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f4dc3ae4-7957-4af4-94c8-d66ddf418427 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/291e31e8-10fe-4fa4-aa1e-fc7c08b75712" status: 200 len: 345 microversion: 2.1 time: 0.095743 May 13 13:23:02.783916 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 11/12] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 13 13:23:02 2022] GET /compute/v2.1/os-volumes/291e31e8-10fe-4fa4-aa1e-fc7c08b75712 => generated 345 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:23:02.796743 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5f0a87dc-2003-404a-a141-b3b5952e2f30 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Action: 'create', calling method: .version_select at 0x7fb0860458b0>, body: {"snapshot": {"volume_id": "291e31e8-10fe-4fa4-aa1e-fc7c08b75712", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-814996462"}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:23:03.472279 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5f0a87dc-2003-404a-a141-b3b5952e2f30 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.681567 May 13 13:23:03.480714 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 12/13] 10.222.0.13 () {60 vars in 1161 bytes} [Fri May 13 13:23:02 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:03.499184 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f8978da3-b349-4a58-8bab-76b340a7570d tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Calling method '.version_select at 0x7fb086045790>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:03.562862 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-48ea3a1e-e09b-4e0d-a4d6-7b4d9f8a0217 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Flavor limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:23:03.564285 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-48ea3a1e-e09b-4e0d-a4d6-7b4d9f8a0217 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Image limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:23:03.564974 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-48ea3a1e-e09b-4e0d-a4d6-7b4d9f8a0217 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Flavor pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:23:03.565603 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-48ea3a1e-e09b-4e0d-a4d6-7b4d9f8a0217 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Image pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:23:03.566156 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-48ea3a1e-e09b-4e0d-a4d6-7b4d9f8a0217 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:23:03.609100 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f8978da3-b349-4a58-8bab-76b340a7570d tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/78096991-e1e6-4038-bcc7-9f5557f103c3" status: 200 len: 286 microversion: 2.1 time: 0.127208 May 13 13:23:03.614830 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 13/14] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 13 13:23:03 2022] GET /compute/v2.1/os-snapshots/78096991-e1e6-4038-bcc7-9f5557f103c3 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:03.620464 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-792de5b9-dce0-4535-b850-d3d7723c9f24 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Calling method '.version_select at 0x7fb086045040>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:03.628894 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48ea3a1e-e09b-4e0d-a4d6-7b4d9f8a0217 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:03.645618 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48ea3a1e-e09b-4e0d-a4d6-7b4d9f8a0217 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:03.647233 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48ea3a1e-e09b-4e0d-a4d6-7b4d9f8a0217 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:03.650124 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48ea3a1e-e09b-4e0d-a4d6-7b4d9f8a0217 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:03.715632 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-792de5b9-dce0-4535-b850-d3d7723c9f24 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.099480 May 13 13:23:03.716136 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 14/15] 10.222.0.13 () {58 vars in 1139 bytes} [Fri May 13 13:23:03 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:03.727940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6f4fdd03-8ac7-41ea-bf8b-bd15c350ca1f tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Calling method '.version_select at 0x7fb08602a280>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:03.792366 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6f4fdd03-8ac7-41ea-bf8b-bd15c350ca1f tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/78096991-e1e6-4038-bcc7-9f5557f103c3" status: 200 len: 286 microversion: 2.1 time: 0.068453 May 13 13:23:03.792939 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 15/16] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 13 13:23:03 2022] GET /compute/v2.1/os-snapshots/78096991-e1e6-4038-bcc7-9f5557f103c3 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:03.806958 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-48ea3a1e-e09b-4e0d-a4d6-7b4d9f8a0217 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Getting quotas for project 53d039bf33554bddb212aeb247b4645e. Resources: {'cores', 'instances', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:23:03.825224 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-48ea3a1e-e09b-4e0d-a4d6-7b4d9f8a0217 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Getting quotas for user f3e6aabf02c94a0d98fc04f75977fe9c and project 53d039bf33554bddb212aeb247b4645e. Resources: {'cores', 'instances', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:23:03.853941 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-48ea3a1e-e09b-4e0d-a4d6-7b4d9f8a0217 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Going to run 1 instances... {{(pid=117720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:23:03.857016 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-48ea3a1e-e09b-4e0d-a4d6-7b4d9f8a0217 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ece294e8-5415-4d6a-a0d3-a14539c51c0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:23:04.085493 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-48ea3a1e-e09b-4e0d-a4d6-7b4d9f8a0217 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.441396 May 13 13:23:04.086518 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 2/17] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 13 13:23:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 13:23:04.097958 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-540c3d51-4992-4461-9454-2378885af956 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:04.098746 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-540c3d51-4992-4461-9454-2378885af956 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:04.367396 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-540c3d51-4992-4461-9454-2378885af956 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:04.405945 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-540c3d51-4992-4461-9454-2378885af956 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1215 microversion: 2.1 time: 0.311910 May 13 13:23:04.419420 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 16/18] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:04 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1215 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:04.805311 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5a08688c-9bd3-4a8f-9496-e710f7db1358 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Calling method '.version_select at 0x7fb0857b83a0>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:04.910044 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5a08688c-9bd3-4a8f-9496-e710f7db1358 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/78096991-e1e6-4038-bcc7-9f5557f103c3" status: 200 len: 286 microversion: 2.1 time: 0.109349 May 13 13:23:04.914555 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 3/19] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 13 13:23:04 2022] GET /compute/v2.1/os-snapshots/78096991-e1e6-4038-bcc7-9f5557f103c3 => generated 286 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:05.433973 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-9c04b705-39df-46b5-a25b-5556dc59f55e tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:05.435413 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-9c04b705-39df-46b5-a25b-5556dc59f55e tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:05.605556 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-9c04b705-39df-46b5-a25b-5556dc59f55e tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:05.613588 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-9c04b705-39df-46b5-a25b-5556dc59f55e tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1215 microversion: 2.1 time: 0.190724 May 13 13:23:05.620487 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 17/20] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:05 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1215 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:05.921647 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-18dabef0-3f80-4760-8ea6-e671f6b3bc13 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Calling method '.version_select at 0x7fb0860a6790>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:05.979148 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-18dabef0-3f80-4760-8ea6-e671f6b3bc13 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/78096991-e1e6-4038-bcc7-9f5557f103c3" status: 200 len: 286 microversion: 2.1 time: 0.062284 May 13 13:23:05.979826 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 4/21] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 13 13:23:05 2022] GET /compute/v2.1/os-snapshots/78096991-e1e6-4038-bcc7-9f5557f103c3 => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:06.645139 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-9de30b1e-f508-4316-843e-a7d2e5758e50 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:06.647984 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-9de30b1e-f508-4316-843e-a7d2e5758e50 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:06.991960 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-79fe27e8-9009-49d1-b923-85231c2af833 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Calling method '.version_select at 0x7fb0857b8940>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:07.054255 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-79fe27e8-9009-49d1-b923-85231c2af833 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/78096991-e1e6-4038-bcc7-9f5557f103c3" status: 200 len: 287 microversion: 2.1 time: 0.066407 May 13 13:23:07.055301 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 5/22] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 13 13:23:06 2022] GET /compute/v2.1/os-snapshots/78096991-e1e6-4038-bcc7-9f5557f103c3 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:07.067269 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f120c9b6-6287-48fe-bc1d-8476a0fe469a tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Calling method '.version_select at 0x7fb0857b8160>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:07.279056 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f120c9b6-6287-48fe-bc1d-8476a0fe469a tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/78096991-e1e6-4038-bcc7-9f5557f103c3" status: 202 len: 0 microversion: 2.1 time: 0.217176 May 13 13:23:07.280427 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 6/23] 10.222.0.13 () {58 vars in 1253 bytes} [Fri May 13 13:23:07 2022] DELETE /compute/v2.1/os-snapshots/78096991-e1e6-4038-bcc7-9f5557f103c3 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 13:23:07.291068 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ceb023a7-33aa-44a2-91ef-55b5990aece7 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Calling method '.version_select at 0x7fb0860a6700>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:07.435653 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-9de30b1e-f508-4316-843e-a7d2e5758e50 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:07.456091 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-9de30b1e-f508-4316-843e-a7d2e5758e50 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1215 microversion: 2.1 time: 0.820200 May 13 13:23:07.460119 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 18/24] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:06 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1215 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:23:07.479143 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ceb023a7-33aa-44a2-91ef-55b5990aece7 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/78096991-e1e6-4038-bcc7-9f5557f103c3" status: 200 len: 286 microversion: 2.1 time: 0.194160 May 13 13:23:07.479907 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 7/25] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 13 13:23:07 2022] GET /compute/v2.1/os-snapshots/78096991-e1e6-4038-bcc7-9f5557f103c3 => generated 286 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:23:08.476833 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-aff1d5ff-f75c-453a-a095-a1d0c40e359a tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:08.477756 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-aff1d5ff-f75c-453a-a095-a1d0c40e359a tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:08.491995 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-dd9605e8-5b90-4e13-9fd2-0bef52914aa6 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Calling method '.version_select at 0x7fb0857b8e50>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:08.500414 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aff1d5ff-f75c-453a-a095-a1d0c40e359a tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:08.506889 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aff1d5ff-f75c-453a-a095-a1d0c40e359a tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:08.510626 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aff1d5ff-f75c-453a-a095-a1d0c40e359a tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:08.511300 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aff1d5ff-f75c-453a-a095-a1d0c40e359a tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:08.662901 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-dd9605e8-5b90-4e13-9fd2-0bef52914aa6 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/78096991-e1e6-4038-bcc7-9f5557f103c3" status: 200 len: 286 microversion: 2.1 time: 0.175326 May 13 13:23:08.664064 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 8/26] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 13 13:23:08 2022] GET /compute/v2.1/os-snapshots/78096991-e1e6-4038-bcc7-9f5557f103c3 => generated 286 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:09.107612 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-aff1d5ff-f75c-453a-a095-a1d0c40e359a tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:09.135510 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-aff1d5ff-f75c-453a-a095-a1d0c40e359a tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1219 microversion: 2.1 time: 0.662286 May 13 13:23:09.136098 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 19/27] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:08 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1219 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:09.678374 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2c95c86d-f490-4e8e-97f0-58a5c03f76b8 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Calling method '.version_select at 0x7fb0857b8310>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:09.857288 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2c95c86d-f490-4e8e-97f0-58a5c03f76b8 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/78096991-e1e6-4038-bcc7-9f5557f103c3" status: 200 len: 286 microversion: 2.1 time: 0.186221 May 13 13:23:09.859427 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 9/28] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 13 13:23:09 2022] GET /compute/v2.1/os-snapshots/78096991-e1e6-4038-bcc7-9f5557f103c3 => generated 286 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:10.152704 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8f79956d-94b7-44b7-9b53-1cc9377a9bd5 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:10.158080 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8ef6a04f-4577-49d5-9948-431e89d977b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-742822720", "imageRef": "ece294e8-5415-4d6a-a0d3-a14539c51c0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:23:10.158582 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8f79956d-94b7-44b7-9b53-1cc9377a9bd5 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:10.204869 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8f79956d-94b7-44b7-9b53-1cc9377a9bd5 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:10.205324 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8f79956d-94b7-44b7-9b53-1cc9377a9bd5 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:10.206118 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8f79956d-94b7-44b7-9b53-1cc9377a9bd5 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:10.222763 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8f79956d-94b7-44b7-9b53-1cc9377a9bd5 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:10.415302 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.network.neutron [None req-8ef6a04f-4577-49d5-9948-431e89d977b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] validate_networks() for [('12caf126-4974-46b6-8013-584333b351af', None, None, None, None, None)] {{(pid=117721) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:23:10.797316 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8f79956d-94b7-44b7-9b53-1cc9377a9bd5 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:10.846157 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8f79956d-94b7-44b7-9b53-1cc9377a9bd5 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1211 microversion: 2.1 time: 0.682778 May 13 13:23:10.850706 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 10/29] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:10 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1211 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:10.876214 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-20414a0d-88f9-4a12-a6c0-6ff331e66ab5 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Calling method '.version_select at 0x7fb084f55550>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:10.983757 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-20414a0d-88f9-4a12-a6c0-6ff331e66ab5 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] HTTP exception thrown: Snapshot 78096991-e1e6-4038-bcc7-9f5557f103c3 could not be found. May 13 13:23:10.992773 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-20414a0d-88f9-4a12-a6c0-6ff331e66ab5 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Request method failure captured: May 13 13:23:10.992773 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/os-snapshots/78096991-e1e6-4038-bcc7-9f5557f103c3 HTTP/1.1 May 13 13:23:10.992773 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept: application/json May 13 13:23:10.992773 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity May 13 13:23:10.992773 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Connection: close May 13 13:23:10.992773 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Length: 0 May 13 13:23:10.992773 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Type: application/json May 13 13:23:10.992773 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Host: 10.222.0.13 May 13 13:23:10.992773 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None May 13 13:23:10.992773 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 May 13 13:23:10.992773 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABifluw4Prv_jdEQ63RqP59UkIuDr0M3SU-rZdq-J3ZCIr3wmvHbzvFKZxoPoYbTYNO16ef4WYa2O76Hhbsjr4U1d6hJk6DH0NAu2oLwJ44vMQCEDdQRBGAV1Ol6YmJqUf2rTS2hBYY4qkW6tZimMqMnZUzZxWjqVW0THdeTNHmkw-8V5k May 13 13:23:10.992773 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Id: None May 13 13:23:10.992773 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Name: None May 13 13:23:10.992773 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed May 13 13:23:10.992773 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True May 13 13:23:10.992773 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default May 13 13:23:10.992773 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default May 13 13:23:10.992773 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Id: f5857dcac665465cbc0b4732c49db220 May 13 13:23:10.992773 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-574993733 May 13 13:23:10.992773 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Role: member,reader May 13 13:23:10.992773 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Roles: member,reader May 13 13:23:10.993906 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f5857dcac665465cbc0b4732c49db220", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f5857dcac665465cbc0b4732c49db220"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f5857dcac665465cbc0b4732c49db220"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f5857dcac665465cbc0b4732c49db220"}]}] May 13 13:23:10.993906 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-VolumesSnapshotsTestJSON-574993733 May 13 13:23:10.993906 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Id: f5857dcac665465cbc0b4732c49db220 May 13 13:23:10.993906 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-574993733 May 13 13:23:10.993906 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User: tempest-VolumesSnapshotsTestJSON-574993733-project May 13 13:23:10.993906 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default May 13 13:23:10.993906 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default May 13 13:23:10.993906 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Id: fbf1e45498d246c5aed54c68acbfdf02 May 13 13:23:10.993906 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-VolumesSnapshotsTestJSON-574993733-project May 13 13:23:10.993906 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: method: May 13 13:23:10.993906 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: exception: Snapshot 78096991-e1e6-4038-bcc7-9f5557f103c3 could not be found. May 13 13:23:10.993906 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: action_args: {'id': '78096991-e1e6-4038-bcc7-9f5557f103c3'} May 13 13:23:10.993906 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:23:10.994589 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:23:10.994589 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 13 13:23:10.994589 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 13 13:23:10.994589 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 13 13:23:10.994589 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 13 13:23:10.994589 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 13 13:23:10.994589 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 13 13:23:10.994589 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:23:10.994589 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:23:10.994589 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:23:10.994589 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:23:10.994589 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:23:10.994589 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:23:10.994589 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:23:10.994589 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:23:10.994589 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 78096991-e1e6-4038-bcc7-9f5557f103c3 could not be found. (HTTP 404) (Request-ID: req-9f04d1aa-affc-4cf1-88be-97039f10e2e8) May 13 13:23:10.994589 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:23:10.994589 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:23:10.995768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:23:10.995768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:23:10.995768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 13 13:23:10.995768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 13 13:23:10.995768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 13:23:10.995768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 13:23:10.995768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 13 13:23:10.995768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 13 13:23:10.995768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 13:23:10.995768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 13:23:10.995768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 13 13:23:10.995768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 13 13:23:10.995768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 13 13:23:10.995768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 13 13:23:10.995768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 13 13:23:10.995768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 13 13:23:10.995768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:23:10.995768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:23:10.995768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:23:10.996889 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:23:10.996889 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:23:10.996889 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:23:10.996889 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:23:10.996889 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:23:10.996889 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 78096991-e1e6-4038-bcc7-9f5557f103c3 could not be found. May 13 13:23:10.996889 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:23:10.996889 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:23:10.996889 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:23:10.996889 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:23:10.996889 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:23:10.996889 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:23:10.996889 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:23:10.996889 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:23:10.996889 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:23:10.996889 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:23:10.996889 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:23:10.996889 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:23:10.996889 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 13 13:23:10.996889 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:23:10.998052 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 78096991-e1e6-4038-bcc7-9f5557f103c3 could not be found. May 13 13:23:10.998052 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:23:10.998052 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:23:10.998052 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:23:10.998052 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:23:10.998052 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:23:10.998052 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:23:10.998052 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:23:10.998052 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:23:10.998052 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 78096991-e1e6-4038-bcc7-9f5557f103c3 could not be found. May 13 13:23:10.998052 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:23:10.998052 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-20414a0d-88f9-4a12-a6c0-6ff331e66ab5 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Returning 404 to user: Snapshot 78096991-e1e6-4038-bcc7-9f5557f103c3 could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:23:10.998052 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-20414a0d-88f9-4a12-a6c0-6ff331e66ab5 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/78096991-e1e6-4038-bcc7-9f5557f103c3" status: 404 len: 111 microversion: 2.1 time: 0.123248 May 13 13:23:10.998052 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 11/30] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 13 13:23:10 2022] GET /compute/v2.1/os-snapshots/78096991-e1e6-4038-bcc7-9f5557f103c3 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 13:23:11.023182 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e0f6e4d3-708a-4940-bd9b-942e7635222f tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Calling method '.version_select at 0x7fb086607e50>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:11.374721 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e0f6e4d3-708a-4940-bd9b-942e7635222f tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/291e31e8-10fe-4fa4-aa1e-fc7c08b75712" status: 202 len: 0 microversion: 2.1 time: 0.375918 May 13 13:23:11.379068 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 12/31] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 13 13:23:10 2022] DELETE /compute/v2.1/os-volumes/291e31e8-10fe-4fa4-aa1e-fc7c08b75712 => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:23:11.390470 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-cac5bf62-be2e-4cc4-baab-96060b594047 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Calling method '.version_select at 0x7fb084e641f0>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:11.540183 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-cac5bf62-be2e-4cc4-baab-96060b594047 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/291e31e8-10fe-4fa4-aa1e-fc7c08b75712" status: 200 len: 344 microversion: 2.1 time: 0.158864 May 13 13:23:11.540958 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 13/32] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 13 13:23:11 2022] GET /compute/v2.1/os-volumes/291e31e8-10fe-4fa4-aa1e-fc7c08b75712 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:11.872868 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8c35dcb1-d6f3-490e-a897-9a5fd2d22244 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:11.873514 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8c35dcb1-d6f3-490e-a897-9a5fd2d22244 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:11.892747 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8c35dcb1-d6f3-490e-a897-9a5fd2d22244 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:11.893213 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8c35dcb1-d6f3-490e-a897-9a5fd2d22244 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:11.894078 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8c35dcb1-d6f3-490e-a897-9a5fd2d22244 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:11.894549 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8c35dcb1-d6f3-490e-a897-9a5fd2d22244 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:12.447602 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-8ef6a04f-4577-49d5-9948-431e89d977b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Flavor limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:23:12.448719 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-8ef6a04f-4577-49d5-9948-431e89d977b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Image limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:23:12.449613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-8ef6a04f-4577-49d5-9948-431e89d977b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Flavor pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:23:12.450220 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-8ef6a04f-4577-49d5-9948-431e89d977b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Image pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:23:12.451206 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-8ef6a04f-4577-49d5-9948-431e89d977b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:23:12.479530 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8ef6a04f-4577-49d5-9948-431e89d977b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:12.481594 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8ef6a04f-4577-49d5-9948-431e89d977b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:12.485286 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8ef6a04f-4577-49d5-9948-431e89d977b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:12.486039 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8ef6a04f-4577-49d5-9948-431e89d977b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:12.486488 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8c35dcb1-d6f3-490e-a897-9a5fd2d22244 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:12.515414 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8c35dcb1-d6f3-490e-a897-9a5fd2d22244 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1275 microversion: 2.1 time: 0.645380 May 13 13:23:12.531829 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 14/33] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:11 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1275 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:23:12.568127 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-8ef6a04f-4577-49d5-9948-431e89d977b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Getting quotas for project a0e165a1f0d34fca81de45a48c6cdbb9. Resources: {'cores', 'instances', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:23:12.576245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-8ef6a04f-4577-49d5-9948-431e89d977b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Getting quotas for user 805e8e6c39f94d3bbcf60930492e297c and project a0e165a1f0d34fca81de45a48c6cdbb9. Resources: {'cores', 'instances', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:23:12.607929 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8ef6a04f-4577-49d5-9948-431e89d977b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Going to run 1 instances... {{(pid=117721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:23:12.620079 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8ef6a04f-4577-49d5-9948-431e89d977b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ece294e8-5415-4d6a-a0d3-a14539c51c0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:23:12.679523 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f4178253-a86a-43c8-bb73-e4d2f4f1eba7 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Action: 'create', calling method: .version_select at 0x7fb084e70700>, body: {"keypair": {"name": "tempest-keypair-339692382", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpsoLZXdsMcyT4D0jUbHb/wgO3FQ4gtZ55YFhBZ0dLeLkF7j80m4mEvopPtCAvIlkswiUoloCFHqni9O18hdeJgZR9dB+1wY7+uQYOiKhZeVpYzhoNAlU8icEuahcGyfg=="}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:23:12.752991 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-f4178253-a86a-43c8-bb73-e4d2f4f1eba7 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Getting quotas for project 6c22198af7e14553a967643df90e501f. Resources: {'key_pairs'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:23:12.758968 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-f4178253-a86a-43c8-bb73-e4d2f4f1eba7 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Getting quotas for user ba9e2d9bbf294793a494709efde09b83 and project 6c22198af7e14553a967643df90e501f. Resources: {'key_pairs'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:23:12.845123 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8ef6a04f-4577-49d5-9948-431e89d977b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.898342 May 13 13:23:12.846383 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 20/34] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 13 13:23:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 2900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:23:12.853110 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-10e11963-db87-4690-9cb7-b49de9a249f5 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Calling method '.version_select at 0x7fb085678c10>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:12.907625 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-10e11963-db87-4690-9cb7-b49de9a249f5 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] HTTP exception thrown: Volume 291e31e8-10fe-4fa4-aa1e-fc7c08b75712 could not be found. May 13 13:23:12.910003 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-10e11963-db87-4690-9cb7-b49de9a249f5 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Request method failure captured: May 13 13:23:12.910003 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/os-volumes/291e31e8-10fe-4fa4-aa1e-fc7c08b75712 HTTP/1.1 May 13 13:23:12.910003 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:23:12.910003 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:23:12.910003 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:23:12.910003 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:23:12.910003 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:23:12.910003 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:23:12.910003 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:23:12.910003 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:23:12.910003 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABifluw4Prv_jdEQ63RqP59UkIuDr0M3SU-rZdq-J3ZCIr3wmvHbzvFKZxoPoYbTYNO16ef4WYa2O76Hhbsjr4U1d6hJk6DH0NAu2oLwJ44vMQCEDdQRBGAV1Ol6YmJqUf2rTS2hBYY4qkW6tZimMqMnZUzZxWjqVW0THdeTNHmkw-8V5k May 13 13:23:12.910003 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:23:12.910003 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:23:12.910003 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:23:12.910003 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:23:12.910003 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:23:12.910003 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:23:12.910003 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: f5857dcac665465cbc0b4732c49db220 May 13 13:23:12.910003 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-574993733 May 13 13:23:12.910003 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:23:12.910003 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:23:12.911319 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f5857dcac665465cbc0b4732c49db220", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f5857dcac665465cbc0b4732c49db220"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f5857dcac665465cbc0b4732c49db220"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f5857dcac665465cbc0b4732c49db220"}]}] May 13 13:23:12.911319 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-VolumesSnapshotsTestJSON-574993733 May 13 13:23:12.911319 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: f5857dcac665465cbc0b4732c49db220 May 13 13:23:12.911319 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-574993733 May 13 13:23:12.911319 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-VolumesSnapshotsTestJSON-574993733-project May 13 13:23:12.911319 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:23:12.911319 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:23:12.911319 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: fbf1e45498d246c5aed54c68acbfdf02 May 13 13:23:12.911319 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-VolumesSnapshotsTestJSON-574993733-project May 13 13:23:12.911319 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: May 13 13:23:12.911319 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Volume 291e31e8-10fe-4fa4-aa1e-fc7c08b75712 could not be found. May 13 13:23:12.911319 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': '291e31e8-10fe-4fa4-aa1e-fc7c08b75712'} May 13 13:23:12.911319 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:23:12.912128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:23:12.912128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:23:12.912128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:23:12.912128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 13:23:12.912128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 13:23:12.912128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 13:23:12.912128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 13:23:12.912128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:23:12.912128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:23:12.912128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:23:12.912128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:23:12.912128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:23:12.912128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:23:12.912128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:23:12.912128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:23:12.912128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 291e31e8-10fe-4fa4-aa1e-fc7c08b75712 could not be found. (HTTP 404) (Request-ID: req-655d4e9d-1c78-4f09-999f-a50136cef225) May 13 13:23:12.912128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:23:12.912128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:23:12.912128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:23:12.913289 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:23:12.913289 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 13:23:12.913289 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 13:23:12.913289 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 13:23:12.913289 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 13:23:12.913289 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 13:23:12.913289 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 13:23:12.913289 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 13:23:12.913289 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 13:23:12.913289 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:23:12.913289 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:23:12.913289 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 13:23:12.913289 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 13:23:12.913289 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 13:23:12.913289 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 13:23:12.913289 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:23:12.913289 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:23:12.913289 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:23:12.913289 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:23:12.916846 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:23:12.916846 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:23:12.916846 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:23:12.916846 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:23:12.916846 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 291e31e8-10fe-4fa4-aa1e-fc7c08b75712 could not be found. May 13 13:23:12.916846 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:23:12.916846 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:23:12.916846 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:23:12.916846 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:23:12.916846 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:23:12.916846 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:23:12.916846 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:23:12.916846 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:23:12.916846 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:23:12.916846 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:23:12.916846 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:23:12.916846 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:23:12.916846 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 13:23:12.916846 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:23:12.918056 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 291e31e8-10fe-4fa4-aa1e-fc7c08b75712 could not be found. May 13 13:23:12.918056 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:23:12.918056 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:23:12.918056 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:23:12.918056 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:23:12.918056 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:23:12.918056 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:23:12.918056 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:23:12.918056 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:23:12.918056 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 291e31e8-10fe-4fa4-aa1e-fc7c08b75712 could not be found. May 13 13:23:12.918056 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:23:12.919171 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-10e11963-db87-4690-9cb7-b49de9a249f5 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Returning 404 to user: Volume 291e31e8-10fe-4fa4-aa1e-fc7c08b75712 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:23:12.920259 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-10e11963-db87-4690-9cb7-b49de9a249f5 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/291e31e8-10fe-4fa4-aa1e-fc7c08b75712" status: 404 len: 109 microversion: 2.1 time: 0.072527 May 13 13:23:12.922028 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 21/35] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 13 13:23:12 2022] GET /compute/v2.1/os-volumes/291e31e8-10fe-4fa4-aa1e-fc7c08b75712 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:23:12.938022 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5bf914cc-a534-4b3d-a4d1-82f92153d377 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:12.940979 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5bf914cc-a534-4b3d-a4d1-82f92153d377 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:12.950565 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f4178253-a86a-43c8-bb73-e4d2f4f1eba7 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.416924 May 13 13:23:12.952279 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 15/36] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 13 13:23:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:12.964165 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3a3d0f31-1f6c-456a-bbc9-77f71c0de4e1 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Calling method '.version_select at 0x7fb0857cc430>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:13.018957 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-3a3d0f31-1f6c-456a-bbc9-77f71c0de4e1 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] HTTP exception thrown: Volume 291e31e8-10fe-4fa4-aa1e-fc7c08b75712 could not be found. May 13 13:23:13.021698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3a3d0f31-1f6c-456a-bbc9-77f71c0de4e1 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Request method failure captured: May 13 13:23:13.021698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: request: DELETE /compute/v2.1/os-volumes/291e31e8-10fe-4fa4-aa1e-fc7c08b75712 HTTP/1.1 May 13 13:23:13.021698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept: application/json May 13 13:23:13.021698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity May 13 13:23:13.021698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Connection: close May 13 13:23:13.021698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Length: 0 May 13 13:23:13.021698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Type: application/json May 13 13:23:13.021698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Host: 10.222.0.13 May 13 13:23:13.021698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None May 13 13:23:13.021698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 May 13 13:23:13.021698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABifluw4Prv_jdEQ63RqP59UkIuDr0M3SU-rZdq-J3ZCIr3wmvHbzvFKZxoPoYbTYNO16ef4WYa2O76Hhbsjr4U1d6hJk6DH0NAu2oLwJ44vMQCEDdQRBGAV1Ol6YmJqUf2rTS2hBYY4qkW6tZimMqMnZUzZxWjqVW0THdeTNHmkw-8V5k May 13 13:23:13.021698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Id: None May 13 13:23:13.021698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Name: None May 13 13:23:13.021698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed May 13 13:23:13.021698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True May 13 13:23:13.021698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default May 13 13:23:13.021698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default May 13 13:23:13.021698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Id: f5857dcac665465cbc0b4732c49db220 May 13 13:23:13.021698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-574993733 May 13 13:23:13.021698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Role: member,reader May 13 13:23:13.021698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Roles: member,reader May 13 13:23:13.031876 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f5857dcac665465cbc0b4732c49db220", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f5857dcac665465cbc0b4732c49db220"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f5857dcac665465cbc0b4732c49db220"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f5857dcac665465cbc0b4732c49db220"}]}] May 13 13:23:13.031876 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-VolumesSnapshotsTestJSON-574993733 May 13 13:23:13.031876 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Id: f5857dcac665465cbc0b4732c49db220 May 13 13:23:13.031876 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-574993733 May 13 13:23:13.031876 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User: tempest-VolumesSnapshotsTestJSON-574993733-project May 13 13:23:13.031876 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default May 13 13:23:13.031876 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default May 13 13:23:13.031876 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Id: fbf1e45498d246c5aed54c68acbfdf02 May 13 13:23:13.031876 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-VolumesSnapshotsTestJSON-574993733-project May 13 13:23:13.031876 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: method: May 13 13:23:13.031876 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: exception: Volume 291e31e8-10fe-4fa4-aa1e-fc7c08b75712 could not be found. May 13 13:23:13.031876 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: action_args: {'id': '291e31e8-10fe-4fa4-aa1e-fc7c08b75712'} May 13 13:23:13.031876 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:23:13.033466 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:23:13.033466 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:23:13.033466 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:23:13.033466 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 13:23:13.033466 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 13:23:13.033466 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 13:23:13.033466 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 13:23:13.033466 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 13:23:13.033466 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 13:23:13.033466 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 13:23:13.033466 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 13:23:13.033466 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:23:13.033466 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:23:13.033466 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:23:13.033466 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:23:13.033466 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 291e31e8-10fe-4fa4-aa1e-fc7c08b75712 could not be found. (HTTP 404) (Request-ID: req-8c8b5c43-370e-4fff-83a0-340d0a311624) May 13 13:23:13.033466 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:23:13.033466 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:23:13.033466 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:23:13.036309 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:23:13.036309 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 13 13:23:13.036309 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 13 13:23:13.036309 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 13:23:13.036309 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 13:23:13.036309 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 13:23:13.036309 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 13:23:13.036309 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 13:23:13.036309 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 13:23:13.036309 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:23:13.036309 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:23:13.036309 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 13:23:13.036309 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 13:23:13.036309 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 13:23:13.036309 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 13:23:13.036309 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 13:23:13.036309 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 13:23:13.036309 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 13:23:13.036309 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 13:23:13.037260 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:23:13.037260 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:23:13.037260 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:23:13.037260 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:23:13.037260 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 291e31e8-10fe-4fa4-aa1e-fc7c08b75712 could not be found. May 13 13:23:13.037260 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:23:13.037260 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:23:13.037260 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:23:13.037260 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:23:13.037260 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:23:13.037260 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:23:13.037260 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:23:13.037260 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:23:13.037260 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:23:13.037260 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:23:13.037260 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:23:13.037260 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:23:13.037260 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 13 13:23:13.037260 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:23:13.038163 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 291e31e8-10fe-4fa4-aa1e-fc7c08b75712 could not be found. May 13 13:23:13.038163 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:23:13.038163 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:23:13.038163 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:23:13.038163 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:23:13.038163 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:23:13.038163 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:23:13.038163 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:23:13.038163 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:23:13.038163 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 291e31e8-10fe-4fa4-aa1e-fc7c08b75712 could not be found. May 13 13:23:13.038163 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:23:13.038163 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3a3d0f31-1f6c-456a-bbc9-77f71c0de4e1 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Returning 404 to user: Volume 291e31e8-10fe-4fa4-aa1e-fc7c08b75712 could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:23:13.038163 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3a3d0f31-1f6c-456a-bbc9-77f71c0de4e1 tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/291e31e8-10fe-4fa4-aa1e-fc7c08b75712" status: 404 len: 109 microversion: 2.1 time: 0.072334 May 13 13:23:13.038163 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 16/37] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 13 13:23:12 2022] DELETE /compute/v2.1/os-volumes/291e31e8-10fe-4fa4-aa1e-fc7c08b75712 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:23:13.041459 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-bceec4eb-5764-4d0e-a490-2b3ca97ac68c tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Calling method '.version_select at 0x7fb084630160>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:13.116939 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-bceec4eb-5764-4d0e-a490-2b3ca97ac68c tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] HTTP exception thrown: Volume 291e31e8-10fe-4fa4-aa1e-fc7c08b75712 could not be found. May 13 13:23:13.118961 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-bceec4eb-5764-4d0e-a490-2b3ca97ac68c tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Request method failure captured: May 13 13:23:13.118961 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/os-volumes/291e31e8-10fe-4fa4-aa1e-fc7c08b75712 HTTP/1.1 May 13 13:23:13.118961 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept: application/json May 13 13:23:13.118961 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity May 13 13:23:13.118961 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Connection: close May 13 13:23:13.118961 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Length: 0 May 13 13:23:13.118961 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Type: application/json May 13 13:23:13.118961 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Host: 10.222.0.13 May 13 13:23:13.118961 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None May 13 13:23:13.118961 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 May 13 13:23:13.118961 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABifluw4Prv_jdEQ63RqP59UkIuDr0M3SU-rZdq-J3ZCIr3wmvHbzvFKZxoPoYbTYNO16ef4WYa2O76Hhbsjr4U1d6hJk6DH0NAu2oLwJ44vMQCEDdQRBGAV1Ol6YmJqUf2rTS2hBYY4qkW6tZimMqMnZUzZxWjqVW0THdeTNHmkw-8V5k May 13 13:23:13.118961 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Id: None May 13 13:23:13.118961 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Name: None May 13 13:23:13.118961 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed May 13 13:23:13.118961 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True May 13 13:23:13.118961 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default May 13 13:23:13.118961 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default May 13 13:23:13.118961 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Id: f5857dcac665465cbc0b4732c49db220 May 13 13:23:13.118961 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-574993733 May 13 13:23:13.118961 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Role: member,reader May 13 13:23:13.118961 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Roles: member,reader May 13 13:23:13.120011 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f5857dcac665465cbc0b4732c49db220", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f5857dcac665465cbc0b4732c49db220"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f5857dcac665465cbc0b4732c49db220"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f5857dcac665465cbc0b4732c49db220"}]}] May 13 13:23:13.120011 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-VolumesSnapshotsTestJSON-574993733 May 13 13:23:13.120011 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Id: f5857dcac665465cbc0b4732c49db220 May 13 13:23:13.120011 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-574993733 May 13 13:23:13.120011 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User: tempest-VolumesSnapshotsTestJSON-574993733-project May 13 13:23:13.120011 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default May 13 13:23:13.120011 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default May 13 13:23:13.120011 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Id: fbf1e45498d246c5aed54c68acbfdf02 May 13 13:23:13.120011 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-VolumesSnapshotsTestJSON-574993733-project May 13 13:23:13.120011 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: method: May 13 13:23:13.120011 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: exception: Volume 291e31e8-10fe-4fa4-aa1e-fc7c08b75712 could not be found. May 13 13:23:13.120011 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: action_args: {'id': '291e31e8-10fe-4fa4-aa1e-fc7c08b75712'} May 13 13:23:13.120011 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:23:13.121568 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:23:13.121568 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:23:13.121568 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:23:13.121568 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 13:23:13.121568 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 13:23:13.121568 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 13:23:13.121568 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 13:23:13.121568 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:23:13.121568 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:23:13.121568 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:23:13.121568 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:23:13.121568 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:23:13.121568 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:23:13.121568 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:23:13.121568 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:23:13.121568 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 291e31e8-10fe-4fa4-aa1e-fc7c08b75712 could not be found. (HTTP 404) (Request-ID: req-28763c83-9297-4069-b36c-85b1fa2d350f) May 13 13:23:13.121568 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:23:13.121568 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:23:13.121568 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:23:13.125358 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:23:13.125358 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 13:23:13.125358 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 13:23:13.125358 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 13:23:13.125358 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 13:23:13.125358 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 13:23:13.125358 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 13:23:13.125358 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 13:23:13.125358 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 13:23:13.125358 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:23:13.125358 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:23:13.125358 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 13:23:13.125358 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 13:23:13.125358 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 13:23:13.125358 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 13:23:13.125358 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:23:13.125358 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:23:13.125358 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:23:13.125358 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:23:13.127689 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:23:13.127689 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:23:13.127689 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:23:13.127689 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:23:13.127689 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 291e31e8-10fe-4fa4-aa1e-fc7c08b75712 could not be found. May 13 13:23:13.127689 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:23:13.127689 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:23:13.127689 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:23:13.127689 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:23:13.127689 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:23:13.127689 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:23:13.127689 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:23:13.127689 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:23:13.127689 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:23:13.127689 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:23:13.127689 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:23:13.127689 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:23:13.127689 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 13:23:13.127689 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:23:13.129503 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 291e31e8-10fe-4fa4-aa1e-fc7c08b75712 could not be found. May 13 13:23:13.129503 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:23:13.129503 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:23:13.129503 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:23:13.129503 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:23:13.129503 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:23:13.129503 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:23:13.129503 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:23:13.129503 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:23:13.129503 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 291e31e8-10fe-4fa4-aa1e-fc7c08b75712 could not be found. May 13 13:23:13.129503 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:23:13.129503 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-bceec4eb-5764-4d0e-a490-2b3ca97ac68c tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] Returning 404 to user: Volume 291e31e8-10fe-4fa4-aa1e-fc7c08b75712 could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:23:13.143059 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-bceec4eb-5764-4d0e-a490-2b3ca97ac68c tempest-VolumesSnapshotsTestJSON-574993733 tempest-VolumesSnapshotsTestJSON-574993733-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/291e31e8-10fe-4fa4-aa1e-fc7c08b75712" status: 404 len: 109 microversion: 2.1 time: 0.110057 May 13 13:23:13.144294 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 17/38] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 13 13:23:13 2022] GET /compute/v2.1/os-volumes/291e31e8-10fe-4fa4-aa1e-fc7c08b75712 => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 13:23:13.283540 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5bf914cc-a534-4b3d-a4d1-82f92153d377 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:13.294148 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5bf914cc-a534-4b3d-a4d1-82f92153d377 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1221 microversion: 2.1 time: 0.370564 May 13 13:23:13.297187 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 22/39] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:12 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1221 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:13.549856 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2425b96b-f339-464f-b479-2990e6fe2535 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:13.550708 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2425b96b-f339-464f-b479-2990e6fe2535 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:13.569874 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2425b96b-f339-464f-b479-2990e6fe2535 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:13.573694 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2425b96b-f339-464f-b479-2990e6fe2535 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:13.575205 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2425b96b-f339-464f-b479-2990e6fe2535 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:13.580529 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2425b96b-f339-464f-b479-2990e6fe2535 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:13.691945 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-75794bd8-ac75-44dc-bfbe-1c3d741ac27a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1304925107", "imageRef": "ece294e8-5415-4d6a-a0d3-a14539c51c0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:23:13.824938 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.network.neutron [None req-75794bd8-ac75-44dc-bfbe-1c3d741ac27a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] validate_networks() for [('12caf126-4974-46b6-8013-584333b351af', None, None, None, None, None)] {{(pid=117721) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:23:14.208268 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2425b96b-f339-464f-b479-2990e6fe2535 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:14.227576 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2425b96b-f339-464f-b479-2990e6fe2535 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1273 microversion: 2.1 time: 0.682582 May 13 13:23:14.238493 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 18/40] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:13 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1273 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:15.093433 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-cb2754fb-c1de-4785-8742-5a11dd9c52fe tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Action: 'create', calling method: .version_select at 0x7fb084630d30>, body: {"keypair": {"name": "tempest-keypair-1930063895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVhsgBn0ZG4UWChV9pzIOjRc83W6AiLqZYMy4w6FLEfraHhSp6ZweATYh7ruIQ4+WLxNjesh+Bq7xCqOv4y7od7rMhcMFu8k7OtFMl/eIg2/we87K6WCxNBofewQv4m1w=="}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:23:15.174262 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-cb2754fb-c1de-4785-8742-5a11dd9c52fe tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Getting quotas for project 99575e3d89514f96b2f6f9d871ba0792. Resources: {'key_pairs'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:23:15.193983 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-cb2754fb-c1de-4785-8742-5a11dd9c52fe tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Getting quotas for user cbbf4d7cd80146458e33ace6cbbe9594 and project 99575e3d89514f96b2f6f9d871ba0792. Resources: {'key_pairs'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:23:15.322723 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-cb2754fb-c1de-4785-8742-5a11dd9c52fe tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.563927 May 13 13:23:15.326768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 19/41] 10.222.0.13 () {62 vars in 1199 bytes} [Fri May 13 13:23:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 569 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 13 13:23:15.334805 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6c39f082-5a7f-42d2-a06d-2738649b6107 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:15.336006 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6c39f082-5a7f-42d2-a06d-2738649b6107 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:15.384529 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6c39f082-5a7f-42d2-a06d-2738649b6107 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:15.384995 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6c39f082-5a7f-42d2-a06d-2738649b6107 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:15.385768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6c39f082-5a7f-42d2-a06d-2738649b6107 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:15.386227 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6c39f082-5a7f-42d2-a06d-2738649b6107 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:16.140510 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6c39f082-5a7f-42d2-a06d-2738649b6107 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:16.153463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6c39f082-5a7f-42d2-a06d-2738649b6107 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1273 microversion: 2.1 time: 0.823020 May 13 13:23:16.185483 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 20/42] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:15 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1273 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:16.539911 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-75794bd8-ac75-44dc-bfbe-1c3d741ac27a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Flavor limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:23:16.539911 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-75794bd8-ac75-44dc-bfbe-1c3d741ac27a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Image limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:23:16.539911 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-75794bd8-ac75-44dc-bfbe-1c3d741ac27a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Flavor pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:23:16.539911 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-75794bd8-ac75-44dc-bfbe-1c3d741ac27a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Image pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:23:16.539911 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-75794bd8-ac75-44dc-bfbe-1c3d741ac27a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:23:16.541533 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-75794bd8-ac75-44dc-bfbe-1c3d741ac27a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:16.541533 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-75794bd8-ac75-44dc-bfbe-1c3d741ac27a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:16.541533 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-75794bd8-ac75-44dc-bfbe-1c3d741ac27a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:16.541533 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-75794bd8-ac75-44dc-bfbe-1c3d741ac27a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:16.542590 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-75794bd8-ac75-44dc-bfbe-1c3d741ac27a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Getting quotas for project a0e165a1f0d34fca81de45a48c6cdbb9. Resources: {'cores', 'instances', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:23:16.542590 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-75794bd8-ac75-44dc-bfbe-1c3d741ac27a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Getting quotas for user 805e8e6c39f94d3bbcf60930492e297c and project a0e165a1f0d34fca81de45a48c6cdbb9. Resources: {'cores', 'instances', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:23:16.542590 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-75794bd8-ac75-44dc-bfbe-1c3d741ac27a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Going to run 1 instances... {{(pid=117721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:23:16.543300 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-75794bd8-ac75-44dc-bfbe-1c3d741ac27a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ece294e8-5415-4d6a-a0d3-a14539c51c0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:23:16.880367 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-75794bd8-ac75-44dc-bfbe-1c3d741ac27a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.194203 May 13 13:23:16.886284 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 23/43] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 13 13:23:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 3201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 13:23:16.894576 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c0d935e5-72fd-45c9-91bf-a56ff1e5b367 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:16.896233 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c0d935e5-72fd-45c9-91bf-a56ff1e5b367 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:17.107901 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c0d935e5-72fd-45c9-91bf-a56ff1e5b367 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:17.162136 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c0d935e5-72fd-45c9-91bf-a56ff1e5b367 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1222 microversion: 2.1 time: 0.274669 May 13 13:23:17.163612 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 21/44] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:16 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1222 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:17.200105 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-71af04d4-49a1-461a-b4c2-616e821d7e50 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:17.200978 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-71af04d4-49a1-461a-b4c2-616e821d7e50 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:17.244957 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-71af04d4-49a1-461a-b4c2-616e821d7e50 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:17.246386 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-71af04d4-49a1-461a-b4c2-616e821d7e50 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:17.256164 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-71af04d4-49a1-461a-b4c2-616e821d7e50 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:17.256164 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-71af04d4-49a1-461a-b4c2-616e821d7e50 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:18.180108 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8eea61dc-ff2a-42e8-881d-d665b62d85e2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:18.180849 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8eea61dc-ff2a-42e8-881d-d665b62d85e2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:18.631887 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-71af04d4-49a1-461a-b4c2-616e821d7e50 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:18.650559 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-71af04d4-49a1-461a-b4c2-616e821d7e50 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1315 microversion: 2.1 time: 1.454147 May 13 13:23:18.671668 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 24/45] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:17 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1315 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:18.705820 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8eea61dc-ff2a-42e8-881d-d665b62d85e2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:18.713211 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8eea61dc-ff2a-42e8-881d-d665b62d85e2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1222 microversion: 2.1 time: 0.537241 May 13 13:23:18.713977 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 22/46] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:18 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1222 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:19.704576 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-80f8b144-0d30-4f0c-8a2d-a5c5d90d1fee tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:19.704576 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-80f8b144-0d30-4f0c-8a2d-a5c5d90d1fee tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:19.716406 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-80f8b144-0d30-4f0c-8a2d-a5c5d90d1fee tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:19.718671 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-80f8b144-0d30-4f0c-8a2d-a5c5d90d1fee tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:19.719523 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-80f8b144-0d30-4f0c-8a2d-a5c5d90d1fee tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:19.724694 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-80f8b144-0d30-4f0c-8a2d-a5c5d90d1fee tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:19.730833 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-84ab4824-e25f-4ff6-b952-b55b98163480 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:19.732188 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-84ab4824-e25f-4ff6-b952-b55b98163480 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:19.755808 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-84ab4824-e25f-4ff6-b952-b55b98163480 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:19.760500 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-84ab4824-e25f-4ff6-b952-b55b98163480 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:19.764145 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-84ab4824-e25f-4ff6-b952-b55b98163480 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:19.764145 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-84ab4824-e25f-4ff6-b952-b55b98163480 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:20.844135 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-84ab4824-e25f-4ff6-b952-b55b98163480 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:20.852787 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-84ab4824-e25f-4ff6-b952-b55b98163480 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1274 microversion: 2.1 time: 1.125846 May 13 13:23:20.859074 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 23/47] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:19 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1274 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:23:21.634784 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-80f8b144-0d30-4f0c-8a2d-a5c5d90d1fee tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:21.646411 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-80f8b144-0d30-4f0c-8a2d-a5c5d90d1fee tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1315 microversion: 2.1 time: 1.959099 May 13 13:23:21.647036 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 25/48] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:19 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1315 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:21.876673 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-85791993-1e22-42b0-9c17-19f84f2c85fd tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:21.878448 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-85791993-1e22-42b0-9c17-19f84f2c85fd tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:21.897618 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-85791993-1e22-42b0-9c17-19f84f2c85fd tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:21.899646 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-85791993-1e22-42b0-9c17-19f84f2c85fd tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:21.901956 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-85791993-1e22-42b0-9c17-19f84f2c85fd tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:21.904151 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-85791993-1e22-42b0-9c17-19f84f2c85fd tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:22.137268 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-85791993-1e22-42b0-9c17-19f84f2c85fd tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:22.150702 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-85791993-1e22-42b0-9c17-19f84f2c85fd tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1280 microversion: 2.1 time: 0.281133 May 13 13:23:22.164093 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 24/49] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:21 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1280 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:22.664992 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f4d77582-9dcb-46ed-b4ec-01dcd0a043a8 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:22.665927 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f4d77582-9dcb-46ed-b4ec-01dcd0a043a8 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:22.686000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f4d77582-9dcb-46ed-b4ec-01dcd0a043a8 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:22.688010 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f4d77582-9dcb-46ed-b4ec-01dcd0a043a8 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:22.691835 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f4d77582-9dcb-46ed-b4ec-01dcd0a043a8 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:22.696195 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f4d77582-9dcb-46ed-b4ec-01dcd0a043a8 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:23.179595 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3f5ce680-5588-49e0-b6f8-7123d402b952 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:23.180312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3f5ce680-5588-49e0-b6f8-7123d402b952 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:23.196506 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3f5ce680-5588-49e0-b6f8-7123d402b952 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:23.197200 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3f5ce680-5588-49e0-b6f8-7123d402b952 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:23.198761 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3f5ce680-5588-49e0-b6f8-7123d402b952 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:23.199620 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3f5ce680-5588-49e0-b6f8-7123d402b952 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:23.414522 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f4d77582-9dcb-46ed-b4ec-01dcd0a043a8 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:23.425141 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f4d77582-9dcb-46ed-b4ec-01dcd0a043a8 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1315 microversion: 2.1 time: 0.765322 May 13 13:23:23.431351 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 26/50] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:22 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1315 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:23.496843 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3f5ce680-5588-49e0-b6f8-7123d402b952 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:23.523324 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3f5ce680-5588-49e0-b6f8-7123d402b952 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1280 microversion: 2.1 time: 0.339654 May 13 13:23:23.534377 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 25/51] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:23 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1280 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:24.447409 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4ee64a08-5810-476a-ac76-5f52db8362da tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:24.448021 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4ee64a08-5810-476a-ac76-5f52db8362da tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:24.456814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4ee64a08-5810-476a-ac76-5f52db8362da tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:24.457261 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4ee64a08-5810-476a-ac76-5f52db8362da tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:24.458036 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4ee64a08-5810-476a-ac76-5f52db8362da tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:24.458767 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4ee64a08-5810-476a-ac76-5f52db8362da tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:24.546767 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0f9bff2e-948f-4d90-8559-f2437ddb306c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:24.548120 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0f9bff2e-948f-4d90-8559-f2437ddb306c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:24.570959 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0f9bff2e-948f-4d90-8559-f2437ddb306c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:24.575031 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0f9bff2e-948f-4d90-8559-f2437ddb306c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:24.588384 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0f9bff2e-948f-4d90-8559-f2437ddb306c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:24.594910 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0f9bff2e-948f-4d90-8559-f2437ddb306c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:24.768402 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0f9bff2e-948f-4d90-8559-f2437ddb306c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:24.778577 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0f9bff2e-948f-4d90-8559-f2437ddb306c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1280 microversion: 2.1 time: 0.241359 May 13 13:23:24.779162 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 26/52] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:24 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1280 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:25.629597 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4ee64a08-5810-476a-ac76-5f52db8362da tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:25.653241 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4ee64a08-5810-476a-ac76-5f52db8362da tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1315 microversion: 2.1 time: 1.209551 May 13 13:23:25.660237 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 27/53] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:24 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1315 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:25.796924 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5b1f3a95-c24f-4e27-91c9-6691298662b0 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:25.797540 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5b1f3a95-c24f-4e27-91c9-6691298662b0 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:25.810980 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5b1f3a95-c24f-4e27-91c9-6691298662b0 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:25.814717 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5b1f3a95-c24f-4e27-91c9-6691298662b0 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:25.816688 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5b1f3a95-c24f-4e27-91c9-6691298662b0 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:25.818813 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5b1f3a95-c24f-4e27-91c9-6691298662b0 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:25.829221 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-3c09943b-58b3-4280-a4ac-51c43c046051 req-8318f0df-64d9-41d7-b375-c062d1e9da68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20c9aa48-48db-4f84-9968-22cc353389ff", "tag": "106f6edc-9afc-4bbf-9485-7d73427f23d2"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:23:25.881934 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-3c09943b-58b3-4280-a4ac-51c43c046051 req-8318f0df-64d9-41d7-b375-c062d1e9da68 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:25.883398 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-3c09943b-58b3-4280-a4ac-51c43c046051 req-8318f0df-64d9-41d7-b375-c062d1e9da68 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:25.938215 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-3c09943b-58b3-4280-a4ac-51c43c046051 req-8318f0df-64d9-41d7-b375-c062d1e9da68 service nova] Creating event network-changed:106f6edc-9afc-4bbf-9485-7d73427f23d2 for instance 20c9aa48-48db-4f84-9968-22cc353389ff on hv-cinder-84163 May 13 13:23:25.944090 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-3c09943b-58b3-4280-a4ac-51c43c046051 req-8318f0df-64d9-41d7-b375-c062d1e9da68 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 13 13:23:25.946143 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6cfb17cd-d613-4c7a-bc24-992ca58084cb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:25.946830 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6cfb17cd-d613-4c7a-bc24-992ca58084cb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:25.947834 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6cfb17cd-d613-4c7a-bc24-992ca58084cb None None] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:25.948466 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6cfb17cd-d613-4c7a-bc24-992ca58084cb None None] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:25.982155 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.compute.rpcapi [None req-6cfb17cd-d613-4c7a-bc24-992ca58084cb None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 13 13:23:25.988398 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6cfb17cd-d613-4c7a-bc24-992ca58084cb None None] Releasing lock "compute-rpcapi-router" {{(pid=117720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 13 13:23:26.025072 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6cfb17cd-d613-4c7a-bc24-992ca58084cb None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.104888 May 13 13:23:26.025815 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 27/54] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:26.286107 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5b1f3a95-c24f-4e27-91c9-6691298662b0 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:26.294905 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5b1f3a95-c24f-4e27-91c9-6691298662b0 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1280 microversion: 2.1 time: 0.501882 May 13 13:23:26.299058 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 28/55] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:25 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1280 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:26.671676 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-36a4c57c-ccd9-4c56-8dcd-4f34bff1201e tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:26.672511 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-36a4c57c-ccd9-4c56-8dcd-4f34bff1201e tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:26.689906 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-36a4c57c-ccd9-4c56-8dcd-4f34bff1201e tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:26.690719 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-36a4c57c-ccd9-4c56-8dcd-4f34bff1201e tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:26.691696 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-36a4c57c-ccd9-4c56-8dcd-4f34bff1201e tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:26.692332 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-36a4c57c-ccd9-4c56-8dcd-4f34bff1201e tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:27.053816 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-f80ce9af-f2db-42c0-831e-b2f48b871d06 req-c71babcc-2b78-4a96-a803-22640e0d37e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75885842-8f4b-43a8-aa30-0da326e4f6e3", "tag": "da8f9c78-af27-45b6-9aff-0e4aa45c7266"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:23:27.080555 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-f80ce9af-f2db-42c0-831e-b2f48b871d06 req-c71babcc-2b78-4a96-a803-22640e0d37e6 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:27.081353 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-f80ce9af-f2db-42c0-831e-b2f48b871d06 req-c71babcc-2b78-4a96-a803-22640e0d37e6 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:27.133791 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-f80ce9af-f2db-42c0-831e-b2f48b871d06 req-c71babcc-2b78-4a96-a803-22640e0d37e6 service nova] Creating event network-changed:da8f9c78-af27-45b6-9aff-0e4aa45c7266 for instance 75885842-8f4b-43a8-aa30-0da326e4f6e3 on hv-cinder-84163 May 13 13:23:27.134496 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-f80ce9af-f2db-42c0-831e-b2f48b871d06 req-c71babcc-2b78-4a96-a803-22640e0d37e6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117721) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 13 13:23:27.135634 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-875d72df-5ecc-45e9-843b-3003f5607bd1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:27.136224 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-875d72df-5ecc-45e9-843b-3003f5607bd1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:27.137129 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-875d72df-5ecc-45e9-843b-3003f5607bd1 None None] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:27.137626 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-875d72df-5ecc-45e9-843b-3003f5607bd1 None None] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:27.152335 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.compute.rpcapi [None req-875d72df-5ecc-45e9-843b-3003f5607bd1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 13 13:23:27.154041 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-875d72df-5ecc-45e9-843b-3003f5607bd1 None None] Releasing lock "compute-rpcapi-router" {{(pid=117721) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 13 13:23:27.203320 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-875d72df-5ecc-45e9-843b-3003f5607bd1 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.363343 May 13 13:23:27.206383 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 29/56] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:27.319271 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d6c641a4-4ab8-4730-9505-f29806eee1db tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:27.321437 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d6c641a4-4ab8-4730-9505-f29806eee1db tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:27.337258 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d6c641a4-4ab8-4730-9505-f29806eee1db tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:27.338093 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d6c641a4-4ab8-4730-9505-f29806eee1db tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:27.339256 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d6c641a4-4ab8-4730-9505-f29806eee1db tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:27.339944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d6c641a4-4ab8-4730-9505-f29806eee1db tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:27.431735 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-36a4c57c-ccd9-4c56-8dcd-4f34bff1201e tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:27.442815 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-36a4c57c-ccd9-4c56-8dcd-4f34bff1201e tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1315 microversion: 2.1 time: 0.775674 May 13 13:23:27.444125 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 28/57] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:26 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1315 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:27.529441 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-71e83ac1-6494-4208-ac1a-b3a4737b92fe tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1420165861", "imageRef": "ece294e8-5415-4d6a-a0d3-a14539c51c0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8aa2b23b-91f7-4a69-a9b1-4be5eb2deeeb"}], "security_groups": [{"name": "tempest-securitygroup--476017381"}], "key_name": "tempest-keypair-339692382", "user_data": "}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:23:27.843256 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.network.neutron [None req-71e83ac1-6494-4208-ac1a-b3a4737b92fe tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] validate_networks() for [('8aa2b23b-91f7-4a69-a9b1-4be5eb2deeeb', None, None, None, None, None)] {{(pid=117720) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:23:28.043773 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d6c641a4-4ab8-4730-9505-f29806eee1db tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:28.051219 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d6c641a4-4ab8-4730-9505-f29806eee1db tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1322 microversion: 2.1 time: 0.737607 May 13 13:23:28.051801 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 30/58] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:27 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1322 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:28.387379 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-23df6cae-1dfe-4bd7-a0d3-a553eb0e49ed tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1211071281", "imageRef": "ece294e8-5415-4d6a-a0d3-a14539c51c0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a7e06528-db27-472b-858f-4ca58111325e"}], "security_groups": [{"name": "tempest-securitygroup--1996927790"}], "key_name": "tempest-keypair-1930063895", "user_data": "}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:23:28.934124 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.network.neutron [None req-23df6cae-1dfe-4bd7-a0d3-a553eb0e49ed tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] validate_networks() for [('a7e06528-db27-472b-858f-4ca58111325e', None, None, None, None, None)] {{(pid=117721) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:23:29.275131 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-71e83ac1-6494-4208-ac1a-b3a4737b92fe tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Flavor limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:23:29.275647 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-71e83ac1-6494-4208-ac1a-b3a4737b92fe tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Image limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:23:29.276010 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-71e83ac1-6494-4208-ac1a-b3a4737b92fe tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Flavor pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:23:29.276413 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-71e83ac1-6494-4208-ac1a-b3a4737b92fe tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Image pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:23:29.276821 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-71e83ac1-6494-4208-ac1a-b3a4737b92fe tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:23:29.295996 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-71e83ac1-6494-4208-ac1a-b3a4737b92fe tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:29.296975 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-71e83ac1-6494-4208-ac1a-b3a4737b92fe tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:29.300303 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-71e83ac1-6494-4208-ac1a-b3a4737b92fe tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:29.300971 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-71e83ac1-6494-4208-ac1a-b3a4737b92fe tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:29.328360 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-71e83ac1-6494-4208-ac1a-b3a4737b92fe tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Getting quotas for project 6c22198af7e14553a967643df90e501f. Resources: {'cores', 'instances', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:23:29.335018 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-71e83ac1-6494-4208-ac1a-b3a4737b92fe tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Getting quotas for user ba9e2d9bbf294793a494709efde09b83 and project 6c22198af7e14553a967643df90e501f. Resources: {'cores', 'instances', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:23:29.350839 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-71e83ac1-6494-4208-ac1a-b3a4737b92fe tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Going to run 1 instances... {{(pid=117720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:23:29.354860 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-71e83ac1-6494-4208-ac1a-b3a4737b92fe tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ece294e8-5415-4d6a-a0d3-a14539c51c0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:23:29.552912 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-71e83ac1-6494-4208-ac1a-b3a4737b92fe tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.029602 May 13 13:23:29.562129 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 29/59] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 13 13:23:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 2039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 13:23:29.589904 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-39b721cf-01d9-48d2-8457-1cd6e9f55fbb tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:29.597765 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-39b721cf-01d9-48d2-8457-1cd6e9f55fbb tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:29.620446 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-39b721cf-01d9-48d2-8457-1cd6e9f55fbb tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:29.624735 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-39b721cf-01d9-48d2-8457-1cd6e9f55fbb tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:29.631651 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-39b721cf-01d9-48d2-8457-1cd6e9f55fbb tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:29.632769 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-39b721cf-01d9-48d2-8457-1cd6e9f55fbb tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:30.098524 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-39b721cf-01d9-48d2-8457-1cd6e9f55fbb tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:30.108180 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-39b721cf-01d9-48d2-8457-1cd6e9f55fbb tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1315 microversion: 2.1 time: 0.541802 May 13 13:23:30.108775 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 30/60] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:29 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:30.124539 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-94dd4397-fdb4-47b0-8b27-b2e2418ce135 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:30.129756 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-94dd4397-fdb4-47b0-8b27-b2e2418ce135 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:30.134996 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-23df6cae-1dfe-4bd7-a0d3-a553eb0e49ed tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Flavor limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:23:30.135498 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-23df6cae-1dfe-4bd7-a0d3-a553eb0e49ed tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Image limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:23:30.137119 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-23df6cae-1dfe-4bd7-a0d3-a553eb0e49ed tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Flavor pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:23:30.137996 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-23df6cae-1dfe-4bd7-a0d3-a553eb0e49ed tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Image pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:23:30.138557 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-23df6cae-1dfe-4bd7-a0d3-a553eb0e49ed tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:23:30.140747 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-94dd4397-fdb4-47b0-8b27-b2e2418ce135 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:30.141396 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-94dd4397-fdb4-47b0-8b27-b2e2418ce135 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:30.142352 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-94dd4397-fdb4-47b0-8b27-b2e2418ce135 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:30.142930 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-94dd4397-fdb4-47b0-8b27-b2e2418ce135 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:30.154604 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-23df6cae-1dfe-4bd7-a0d3-a553eb0e49ed tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:30.163800 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-23df6cae-1dfe-4bd7-a0d3-a553eb0e49ed tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:30.166910 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-23df6cae-1dfe-4bd7-a0d3-a553eb0e49ed tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:30.167695 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-23df6cae-1dfe-4bd7-a0d3-a553eb0e49ed tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:30.226777 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-23df6cae-1dfe-4bd7-a0d3-a553eb0e49ed tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Getting quotas for project 99575e3d89514f96b2f6f9d871ba0792. Resources: {'cores', 'instances', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:23:30.236453 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-23df6cae-1dfe-4bd7-a0d3-a553eb0e49ed tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Getting quotas for user cbbf4d7cd80146458e33ace6cbbe9594 and project 99575e3d89514f96b2f6f9d871ba0792. Resources: {'cores', 'instances', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:23:30.262599 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-23df6cae-1dfe-4bd7-a0d3-a553eb0e49ed tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Going to run 1 instances... {{(pid=117721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:23:30.272116 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-23df6cae-1dfe-4bd7-a0d3-a553eb0e49ed tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ece294e8-5415-4d6a-a0d3-a14539c51c0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:23:30.491421 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-23df6cae-1dfe-4bd7-a0d3-a553eb0e49ed tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.111368 May 13 13:23:30.492255 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 31/61] 10.222.0.13 () {62 vars in 1187 bytes} [Fri May 13 13:23:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 2113 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 13 13:23:30.523217 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5a9400f9-3aa4-46ec-9fc0-9cb05b8da235 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:30.523852 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5a9400f9-3aa4-46ec-9fc0-9cb05b8da235 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:30.829079 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5a9400f9-3aa4-46ec-9fc0-9cb05b8da235 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:30.839927 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5a9400f9-3aa4-46ec-9fc0-9cb05b8da235 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1237 microversion: 2.1 time: 0.336982 May 13 13:23:30.851251 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 32/62] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:30 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1237 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:30.856281 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-522d0432-90b5-42d9-bf65-9d9761eff209 req-5124e119-bf9e-4c44-95d9-bb0486a548fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e075348c-c206-4d9a-bfdd-a62857c07dec", "tag": "0f02d863-38e9-4d24-99ba-89d714b38cb6"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:23:30.878018 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-522d0432-90b5-42d9-bf65-9d9761eff209 req-5124e119-bf9e-4c44-95d9-bb0486a548fe service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:30.880524 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-522d0432-90b5-42d9-bf65-9d9761eff209 req-5124e119-bf9e-4c44-95d9-bb0486a548fe service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:30.913745 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-522d0432-90b5-42d9-bf65-9d9761eff209 req-5124e119-bf9e-4c44-95d9-bb0486a548fe service nova] Creating event network-changed:0f02d863-38e9-4d24-99ba-89d714b38cb6 for instance e075348c-c206-4d9a-bfdd-a62857c07dec on hv-cinder-84163 May 13 13:23:30.964777 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-522d0432-90b5-42d9-bf65-9d9761eff209 req-5124e119-bf9e-4c44-95d9-bb0486a548fe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078546 May 13 13:23:30.964777 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 33/63] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:30.964777 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0f07a273-6ac4-410d-a9ed-56dd474b218a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:30.964777 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0f07a273-6ac4-410d-a9ed-56dd474b218a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:31.121882 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0f07a273-6ac4-410d-a9ed-56dd474b218a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:31.136065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0f07a273-6ac4-410d-a9ed-56dd474b218a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:31.137607 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0f07a273-6ac4-410d-a9ed-56dd474b218a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:31.144490 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-94dd4397-fdb4-47b0-8b27-b2e2418ce135 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:31.150110 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0f07a273-6ac4-410d-a9ed-56dd474b218a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1282 microversion: 2.20 time: 0.211230 May 13 13:23:31.154049 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 34/64] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:23:30 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1282 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:23:31.157804 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-94dd4397-fdb4-47b0-8b27-b2e2418ce135 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1322 microversion: 2.1 time: 1.037294 May 13 13:23:31.161349 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 31/65] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:30 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1322 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:31.186910 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-92e05826-06c1-4ed4-a9c4-2b6cd307467c tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:31.187756 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-92e05826-06c1-4ed4-a9c4-2b6cd307467c tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:31.195460 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-92e05826-06c1-4ed4-a9c4-2b6cd307467c tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:31.196302 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-92e05826-06c1-4ed4-a9c4-2b6cd307467c tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:31.197507 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-92e05826-06c1-4ed4-a9c4-2b6cd307467c tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:31.198149 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-92e05826-06c1-4ed4-a9c4-2b6cd307467c tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:31.475637 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-92e05826-06c1-4ed4-a9c4-2b6cd307467c tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:31.493072 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-92e05826-06c1-4ed4-a9c4-2b6cd307467c tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1315 microversion: 2.1 time: 0.337042 May 13 13:23:31.509825 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 35/66] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:31 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:31.863729 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4156e576-f44b-4ab3-86b2-5aba8527ea73 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:31.864695 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4156e576-f44b-4ab3-86b2-5aba8527ea73 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:31.874545 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4156e576-f44b-4ab3-86b2-5aba8527ea73 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:31.875097 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4156e576-f44b-4ab3-86b2-5aba8527ea73 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:31.875950 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4156e576-f44b-4ab3-86b2-5aba8527ea73 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:31.876394 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4156e576-f44b-4ab3-86b2-5aba8527ea73 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:31.942451 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4156e576-f44b-4ab3-86b2-5aba8527ea73 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:31.950009 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4156e576-f44b-4ab3-86b2-5aba8527ea73 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1241 microversion: 2.1 time: 0.092384 May 13 13:23:31.950613 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 32/67] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:31 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:32.171865 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-12402615-1b5a-44f6-90b0-31684ed7496d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:32.172836 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-12402615-1b5a-44f6-90b0-31684ed7496d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:32.181712 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2f50e645-5b16-40f9-a8e6-4733be6c058e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:32.182601 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2f50e645-5b16-40f9-a8e6-4733be6c058e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:32.190628 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2f50e645-5b16-40f9-a8e6-4733be6c058e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:32.191144 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2f50e645-5b16-40f9-a8e6-4733be6c058e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:32.191928 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2f50e645-5b16-40f9-a8e6-4733be6c058e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:32.194816 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2f50e645-5b16-40f9-a8e6-4733be6c058e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:32.233835 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-12402615-1b5a-44f6-90b0-31684ed7496d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:32.241599 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-12402615-1b5a-44f6-90b0-31684ed7496d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:32.243188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-12402615-1b5a-44f6-90b0-31684ed7496d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:32.256195 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-12402615-1b5a-44f6-90b0-31684ed7496d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1282 microversion: 2.20 time: 0.076493 May 13 13:23:32.256195 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 36/68] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:23:32 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1282 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:23:32.382422 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2f50e645-5b16-40f9-a8e6-4733be6c058e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:32.391523 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2f50e645-5b16-40f9-a8e6-4733be6c058e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1322 microversion: 2.1 time: 0.214821 May 13 13:23:32.392376 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 33/69] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:32 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:23:32.517959 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6328b426-2002-4b05-b6d6-9287e34ba35d tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:32.518444 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6328b426-2002-4b05-b6d6-9287e34ba35d tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:32.528904 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6328b426-2002-4b05-b6d6-9287e34ba35d tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:32.528904 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6328b426-2002-4b05-b6d6-9287e34ba35d tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:32.528904 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6328b426-2002-4b05-b6d6-9287e34ba35d tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:32.528904 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6328b426-2002-4b05-b6d6-9287e34ba35d tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:32.668193 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6328b426-2002-4b05-b6d6-9287e34ba35d tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:32.675723 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6328b426-2002-4b05-b6d6-9287e34ba35d tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1315 microversion: 2.1 time: 0.162612 May 13 13:23:32.676346 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 37/70] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:32 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:32.968462 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d6c7bbf7-cf8b-4ce0-92c0-54334791ec0e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:32.969083 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d6c7bbf7-cf8b-4ce0-92c0-54334791ec0e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:32.974973 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d6c7bbf7-cf8b-4ce0-92c0-54334791ec0e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:32.975451 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d6c7bbf7-cf8b-4ce0-92c0-54334791ec0e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:32.976628 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d6c7bbf7-cf8b-4ce0-92c0-54334791ec0e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:32.976718 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d6c7bbf7-cf8b-4ce0-92c0-54334791ec0e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:33.038402 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d6c7bbf7-cf8b-4ce0-92c0-54334791ec0e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:33.049238 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d6c7bbf7-cf8b-4ce0-92c0-54334791ec0e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1233 microversion: 2.1 time: 0.084916 May 13 13:23:33.051227 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 34/71] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:32 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1233 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:33.264331 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-80e53d98-8e9b-4c64-9862-5a3198ffa16b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:33.265072 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-80e53d98-8e9b-4c64-9862-5a3198ffa16b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:33.271091 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-80e53d98-8e9b-4c64-9862-5a3198ffa16b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:33.271535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-80e53d98-8e9b-4c64-9862-5a3198ffa16b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:33.276052 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-80e53d98-8e9b-4c64-9862-5a3198ffa16b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:33.276052 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-80e53d98-8e9b-4c64-9862-5a3198ffa16b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:33.339004 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-80e53d98-8e9b-4c64-9862-5a3198ffa16b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:33.347307 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-80e53d98-8e9b-4c64-9862-5a3198ffa16b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:33.348804 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-80e53d98-8e9b-4c64-9862-5a3198ffa16b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:33.350072 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-80e53d98-8e9b-4c64-9862-5a3198ffa16b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1286 microversion: 2.20 time: 0.089953 May 13 13:23:33.350787 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 38/72] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:23:33 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:23:33.409375 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-af3719ff-fb7e-4e52-b3b5-a079547134ee tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:33.409903 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-af3719ff-fb7e-4e52-b3b5-a079547134ee tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:33.423938 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-af3719ff-fb7e-4e52-b3b5-a079547134ee tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:33.423938 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-af3719ff-fb7e-4e52-b3b5-a079547134ee tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:33.423938 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-af3719ff-fb7e-4e52-b3b5-a079547134ee tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:33.423938 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-af3719ff-fb7e-4e52-b3b5-a079547134ee tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:33.569350 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-af3719ff-fb7e-4e52-b3b5-a079547134ee tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:33.584216 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-af3719ff-fb7e-4e52-b3b5-a079547134ee tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1322 microversion: 2.1 time: 0.178583 May 13 13:23:33.590620 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 35/73] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:33 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:33.693076 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-521c7bc2-37d9-4a09-98a8-d4a579da4833 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:33.693682 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-521c7bc2-37d9-4a09-98a8-d4a579da4833 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:33.699517 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-521c7bc2-37d9-4a09-98a8-d4a579da4833 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:33.699963 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-521c7bc2-37d9-4a09-98a8-d4a579da4833 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:33.700726 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-521c7bc2-37d9-4a09-98a8-d4a579da4833 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:33.701155 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-521c7bc2-37d9-4a09-98a8-d4a579da4833 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:33.840529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-521c7bc2-37d9-4a09-98a8-d4a579da4833 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:33.848997 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-521c7bc2-37d9-4a09-98a8-d4a579da4833 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1315 microversion: 2.1 time: 0.159739 May 13 13:23:33.849567 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 39/74] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:33 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:34.068315 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b8fef161-9274-4e25-aa7a-55eff5f20cae tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:34.069002 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b8fef161-9274-4e25-aa7a-55eff5f20cae tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:34.084269 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b8fef161-9274-4e25-aa7a-55eff5f20cae tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:34.084269 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b8fef161-9274-4e25-aa7a-55eff5f20cae tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:34.084269 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b8fef161-9274-4e25-aa7a-55eff5f20cae tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:34.084269 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b8fef161-9274-4e25-aa7a-55eff5f20cae tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:34.173100 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b8fef161-9274-4e25-aa7a-55eff5f20cae tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:34.180444 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b8fef161-9274-4e25-aa7a-55eff5f20cae tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1233 microversion: 2.1 time: 0.116402 May 13 13:23:34.181316 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 36/75] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:34 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1233 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:34.369002 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1b092c39-f4e2-4a0f-b306-7ecc2b3605ba tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:34.369605 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1b092c39-f4e2-4a0f-b306-7ecc2b3605ba tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:34.376234 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1b092c39-f4e2-4a0f-b306-7ecc2b3605ba tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:34.376673 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1b092c39-f4e2-4a0f-b306-7ecc2b3605ba tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:34.377432 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1b092c39-f4e2-4a0f-b306-7ecc2b3605ba tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:34.377862 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1b092c39-f4e2-4a0f-b306-7ecc2b3605ba tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:34.439567 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1b092c39-f4e2-4a0f-b306-7ecc2b3605ba tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:34.447792 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1b092c39-f4e2-4a0f-b306-7ecc2b3605ba tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:34.449291 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1b092c39-f4e2-4a0f-b306-7ecc2b3605ba tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:34.450417 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1b092c39-f4e2-4a0f-b306-7ecc2b3605ba tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1286 microversion: 2.20 time: 0.085387 May 13 13:23:34.451154 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 40/76] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:23:34 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:23:34.602482 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-df015260-36b8-49b7-abaa-6037740cfbe7 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:34.603097 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-df015260-36b8-49b7-abaa-6037740cfbe7 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:34.609000 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-df015260-36b8-49b7-abaa-6037740cfbe7 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:34.609583 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-df015260-36b8-49b7-abaa-6037740cfbe7 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:34.610255 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-df015260-36b8-49b7-abaa-6037740cfbe7 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:34.610692 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-df015260-36b8-49b7-abaa-6037740cfbe7 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:34.831686 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-df015260-36b8-49b7-abaa-6037740cfbe7 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:34.847638 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-df015260-36b8-49b7-abaa-6037740cfbe7 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1322 microversion: 2.1 time: 0.248844 May 13 13:23:34.850380 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 37/77] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:34 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:34.865288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-72af7cd0-9a3a-4b3b-a82b-13914bc15531 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:34.866237 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-72af7cd0-9a3a-4b3b-a82b-13914bc15531 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:34.872874 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72af7cd0-9a3a-4b3b-a82b-13914bc15531 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:34.873919 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72af7cd0-9a3a-4b3b-a82b-13914bc15531 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:34.874946 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72af7cd0-9a3a-4b3b-a82b-13914bc15531 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:34.875550 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72af7cd0-9a3a-4b3b-a82b-13914bc15531 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:35.085133 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-72af7cd0-9a3a-4b3b-a82b-13914bc15531 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:35.094579 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-72af7cd0-9a3a-4b3b-a82b-13914bc15531 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1315 microversion: 2.1 time: 0.233308 May 13 13:23:35.104113 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 41/78] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:34 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:35.212784 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-11a295ee-2390-4d9a-857b-801dbbbc5248 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:35.213394 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-11a295ee-2390-4d9a-857b-801dbbbc5248 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:35.220354 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-11a295ee-2390-4d9a-857b-801dbbbc5248 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:35.227371 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-11a295ee-2390-4d9a-857b-801dbbbc5248 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:35.227371 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-11a295ee-2390-4d9a-857b-801dbbbc5248 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:35.227371 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-11a295ee-2390-4d9a-857b-801dbbbc5248 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:35.289039 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-11a295ee-2390-4d9a-857b-801dbbbc5248 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:35.297578 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-11a295ee-2390-4d9a-857b-801dbbbc5248 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1289 microversion: 2.1 time: 0.090242 May 13 13:23:35.298250 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 38/79] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:35 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1289 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:35.471781 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-626fb14b-2b6c-47aa-b89d-4e15006b999a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:35.472979 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-626fb14b-2b6c-47aa-b89d-4e15006b999a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:35.485472 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-626fb14b-2b6c-47aa-b89d-4e15006b999a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:35.485936 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-626fb14b-2b6c-47aa-b89d-4e15006b999a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:35.488886 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-626fb14b-2b6c-47aa-b89d-4e15006b999a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:35.489353 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-626fb14b-2b6c-47aa-b89d-4e15006b999a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:35.585474 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-626fb14b-2b6c-47aa-b89d-4e15006b999a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:35.610918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-626fb14b-2b6c-47aa-b89d-4e15006b999a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:35.614501 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-626fb14b-2b6c-47aa-b89d-4e15006b999a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:35.616413 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-626fb14b-2b6c-47aa-b89d-4e15006b999a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1334 microversion: 2.20 time: 0.151022 May 13 13:23:35.631170 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 42/80] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:23:35 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1334 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:23:35.864853 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-652a4b00-298c-46e2-abde-a87a443f889b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:35.865460 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-652a4b00-298c-46e2-abde-a87a443f889b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:35.882695 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-652a4b00-298c-46e2-abde-a87a443f889b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:35.883485 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-652a4b00-298c-46e2-abde-a87a443f889b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:35.884488 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-652a4b00-298c-46e2-abde-a87a443f889b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:35.885148 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-652a4b00-298c-46e2-abde-a87a443f889b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:36.113136 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8bfd8dc6-342e-4c6b-a679-58b7ff087019 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:36.115646 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8bfd8dc6-342e-4c6b-a679-58b7ff087019 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:36.143677 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8bfd8dc6-342e-4c6b-a679-58b7ff087019 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:36.148535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8bfd8dc6-342e-4c6b-a679-58b7ff087019 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:36.157076 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8bfd8dc6-342e-4c6b-a679-58b7ff087019 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:36.161086 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8bfd8dc6-342e-4c6b-a679-58b7ff087019 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:36.179443 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-652a4b00-298c-46e2-abde-a87a443f889b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:36.189122 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-652a4b00-298c-46e2-abde-a87a443f889b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1322 microversion: 2.1 time: 0.327968 May 13 13:23:36.202682 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 39/81] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:35 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:36.319687 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b1718c24-5383-44cd-b31c-ad74fbad1e3a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:36.319687 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b1718c24-5383-44cd-b31c-ad74fbad1e3a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:36.340157 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b1718c24-5383-44cd-b31c-ad74fbad1e3a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:36.344886 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b1718c24-5383-44cd-b31c-ad74fbad1e3a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:36.345857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b1718c24-5383-44cd-b31c-ad74fbad1e3a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:36.346412 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b1718c24-5383-44cd-b31c-ad74fbad1e3a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:36.483765 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b1718c24-5383-44cd-b31c-ad74fbad1e3a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:36.493410 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b1718c24-5383-44cd-b31c-ad74fbad1e3a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1295 microversion: 2.1 time: 0.180599 May 13 13:23:36.494585 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 40/82] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:36 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1295 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:23:36.594794 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8bfd8dc6-342e-4c6b-a679-58b7ff087019 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:36.607724 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8bfd8dc6-342e-4c6b-a679-58b7ff087019 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1315 microversion: 2.1 time: 0.500404 May 13 13:23:36.609562 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 43/83] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:36 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1315 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:36.641009 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-62824ed0-8347-4f68-828b-ba2184652e33 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:36.641758 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-62824ed0-8347-4f68-828b-ba2184652e33 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:36.648606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-62824ed0-8347-4f68-828b-ba2184652e33 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:36.649475 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-62824ed0-8347-4f68-828b-ba2184652e33 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:36.651339 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-62824ed0-8347-4f68-828b-ba2184652e33 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:36.652455 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-62824ed0-8347-4f68-828b-ba2184652e33 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:36.758000 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-62824ed0-8347-4f68-828b-ba2184652e33 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:36.758000 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-62824ed0-8347-4f68-828b-ba2184652e33 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:36.758913 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-62824ed0-8347-4f68-828b-ba2184652e33 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:36.758913 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-62824ed0-8347-4f68-828b-ba2184652e33 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1352 microversion: 2.20 time: 0.106125 May 13 13:23:36.758913 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 41/84] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:23:36 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:23:37.205204 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-29c86379-cf8f-4f4a-8fd6-e4cee5f8b221 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:37.205808 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-29c86379-cf8f-4f4a-8fd6-e4cee5f8b221 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:37.212118 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-29c86379-cf8f-4f4a-8fd6-e4cee5f8b221 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:37.212562 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-29c86379-cf8f-4f4a-8fd6-e4cee5f8b221 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:37.213320 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-29c86379-cf8f-4f4a-8fd6-e4cee5f8b221 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:37.213752 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-29c86379-cf8f-4f4a-8fd6-e4cee5f8b221 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:37.408182 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-29c86379-cf8f-4f4a-8fd6-e4cee5f8b221 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:37.423663 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-29c86379-cf8f-4f4a-8fd6-e4cee5f8b221 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1322 microversion: 2.1 time: 0.222445 May 13 13:23:37.432765 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 44/85] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:37 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:37.511911 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ed8988ae-feb3-4eea-9b07-96eb4f353afa tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:37.512558 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ed8988ae-feb3-4eea-9b07-96eb4f353afa tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:37.523895 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ed8988ae-feb3-4eea-9b07-96eb4f353afa tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:37.525328 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ed8988ae-feb3-4eea-9b07-96eb4f353afa tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:37.526441 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ed8988ae-feb3-4eea-9b07-96eb4f353afa tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:37.527075 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ed8988ae-feb3-4eea-9b07-96eb4f353afa tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:37.637456 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b8ea1540-3709-4794-bae7-410c638b8589 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:37.638104 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b8ea1540-3709-4794-bae7-410c638b8589 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:37.659204 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b8ea1540-3709-4794-bae7-410c638b8589 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:37.659666 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b8ea1540-3709-4794-bae7-410c638b8589 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:37.660502 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b8ea1540-3709-4794-bae7-410c638b8589 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:37.663086 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b8ea1540-3709-4794-bae7-410c638b8589 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:38.100332 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ed8988ae-feb3-4eea-9b07-96eb4f353afa tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:38.108491 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ed8988ae-feb3-4eea-9b07-96eb4f353afa tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1362 microversion: 2.1 time: 0.600288 May 13 13:23:38.115615 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 42/86] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:37 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1362 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:38.120540 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f219a71f-d727-4c35-bb97-749e2d369951 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:38.121144 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f219a71f-d727-4c35-bb97-749e2d369951 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:38.139713 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f219a71f-d727-4c35-bb97-749e2d369951 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:38.140296 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f219a71f-d727-4c35-bb97-749e2d369951 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:38.141075 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f219a71f-d727-4c35-bb97-749e2d369951 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:38.148822 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f219a71f-d727-4c35-bb97-749e2d369951 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:38.156222 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b8ea1540-3709-4794-bae7-410c638b8589 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:38.169167 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b8ea1540-3709-4794-bae7-410c638b8589 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1315 microversion: 2.1 time: 0.544617 May 13 13:23:38.170719 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 45/87] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:37 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:23:38.366290 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-ac31061f-9977-4b91-bd07-1571bc53f310 req-d7e98146-4235-4483-a0ad-27ae21c86620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c9aa48-48db-4f84-9968-22cc353389ff", "name": "network-vif-plugged", "status": "completed", "tag": "106f6edc-9afc-4bbf-9485-7d73427f23d2"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:23:38.379725 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-ac31061f-9977-4b91-bd07-1571bc53f310 req-d7e98146-4235-4483-a0ad-27ae21c86620 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:38.380168 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-ac31061f-9977-4b91-bd07-1571bc53f310 req-d7e98146-4235-4483-a0ad-27ae21c86620 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:38.398363 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f219a71f-d727-4c35-bb97-749e2d369951 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:38.408607 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-ac31061f-9977-4b91-bd07-1571bc53f310 req-d7e98146-4235-4483-a0ad-27ae21c86620 service nova] Creating event network-vif-plugged:106f6edc-9afc-4bbf-9485-7d73427f23d2 for instance 20c9aa48-48db-4f84-9968-22cc353389ff on hv-cinder-84163 May 13 13:23:38.412124 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f219a71f-d727-4c35-bb97-749e2d369951 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:38.415628 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f219a71f-d727-4c35-bb97-749e2d369951 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:38.416202 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-ac31061f-9977-4b91-bd07-1571bc53f310 req-d7e98146-4235-4483-a0ad-27ae21c86620 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.243631 May 13 13:23:38.425042 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 46/88] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:38.428524 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f219a71f-d727-4c35-bb97-749e2d369951 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1340 microversion: 2.20 time: 0.311633 May 13 13:23:38.440649 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 43/89] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:23:38 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1340 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:23:38.441324 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-796bf391-4c15-4f10-8418-621780083dfc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:38.442016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-796bf391-4c15-4f10-8418-621780083dfc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:38.458648 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-796bf391-4c15-4f10-8418-621780083dfc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:38.459457 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-796bf391-4c15-4f10-8418-621780083dfc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:38.460242 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-796bf391-4c15-4f10-8418-621780083dfc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:38.460670 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-796bf391-4c15-4f10-8418-621780083dfc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:38.741110 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-796bf391-4c15-4f10-8418-621780083dfc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:38.761461 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-796bf391-4c15-4f10-8418-621780083dfc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1322 microversion: 2.1 time: 0.320750 May 13 13:23:38.762370 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 47/90] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:38 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1322 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:39.125806 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0d6a7433-65ab-40b9-83e4-1e132211541c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:39.126536 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0d6a7433-65ab-40b9-83e4-1e132211541c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:39.135996 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0d6a7433-65ab-40b9-83e4-1e132211541c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:39.140953 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0d6a7433-65ab-40b9-83e4-1e132211541c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:39.141789 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0d6a7433-65ab-40b9-83e4-1e132211541c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:39.142258 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0d6a7433-65ab-40b9-83e4-1e132211541c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:39.189572 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7dbb0a2b-6040-49d0-bc95-3c2cad34828b tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:39.191827 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7dbb0a2b-6040-49d0-bc95-3c2cad34828b tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:39.200951 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7dbb0a2b-6040-49d0-bc95-3c2cad34828b tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:39.211972 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7dbb0a2b-6040-49d0-bc95-3c2cad34828b tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:39.222890 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7dbb0a2b-6040-49d0-bc95-3c2cad34828b tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:39.223889 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7dbb0a2b-6040-49d0-bc95-3c2cad34828b tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:39.835769 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7dbb0a2b-6040-49d0-bc95-3c2cad34828b tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:39.847460 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7dbb0a2b-6040-49d0-bc95-3c2cad34828b tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1315 microversion: 2.1 time: 0.664305 May 13 13:23:39.850507 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0d6a7433-65ab-40b9-83e4-1e132211541c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:39.851423 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 48/91] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:39 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1315 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:23:39.872132 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-ed18189a-97ba-44c9-91b3-57545606a69f req-4be9e54a-0d3d-48bf-819e-aac14dc87f47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b2c2709-a695-4f16-a0fa-fed674cfab86", "tag": "bb022415-b3c9-4b44-a6e4-3190a75170e0"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:23:39.882147 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0d6a7433-65ab-40b9-83e4-1e132211541c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1362 microversion: 2.1 time: 0.760547 May 13 13:23:39.892906 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-ed18189a-97ba-44c9-91b3-57545606a69f req-4be9e54a-0d3d-48bf-819e-aac14dc87f47 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:39.893489 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-ed18189a-97ba-44c9-91b3-57545606a69f req-4be9e54a-0d3d-48bf-819e-aac14dc87f47 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:39.909237 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 44/92] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:39 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1362 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:39.917118 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a6f35dcf-b19f-4194-9e97-62391de9d1db tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:39.917720 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a6f35dcf-b19f-4194-9e97-62391de9d1db tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:39.921785 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-ed18189a-97ba-44c9-91b3-57545606a69f req-4be9e54a-0d3d-48bf-819e-aac14dc87f47 service nova] Creating event network-changed:bb022415-b3c9-4b44-a6e4-3190a75170e0 for instance 3b2c2709-a695-4f16-a0fa-fed674cfab86 on hv-cinder-84163 May 13 13:23:39.934587 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a6f35dcf-b19f-4194-9e97-62391de9d1db tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:39.942695 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a6f35dcf-b19f-4194-9e97-62391de9d1db tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:39.942695 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a6f35dcf-b19f-4194-9e97-62391de9d1db tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:39.942695 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a6f35dcf-b19f-4194-9e97-62391de9d1db tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:39.943977 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-ed18189a-97ba-44c9-91b3-57545606a69f req-4be9e54a-0d3d-48bf-819e-aac14dc87f47 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087171 May 13 13:23:39.943977 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 49/93] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:39.965656 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8c960a78-bd09-40d9-be45-6630b5e02347 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:39.966381 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8c960a78-bd09-40d9-be45-6630b5e02347 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:39.985959 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c960a78-bd09-40d9-be45-6630b5e02347 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:39.986715 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c960a78-bd09-40d9-be45-6630b5e02347 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:39.987736 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c960a78-bd09-40d9-be45-6630b5e02347 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:39.988315 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c960a78-bd09-40d9-be45-6630b5e02347 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:40.424661 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a6f35dcf-b19f-4194-9e97-62391de9d1db tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:40.437125 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a6f35dcf-b19f-4194-9e97-62391de9d1db tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:40.439709 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a6f35dcf-b19f-4194-9e97-62391de9d1db tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:40.441171 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a6f35dcf-b19f-4194-9e97-62391de9d1db tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1408 microversion: 2.20 time: 0.533331 May 13 13:23:40.456177 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 45/94] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:23:39 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1408 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:23:40.472276 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8c960a78-bd09-40d9-be45-6630b5e02347 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:40.489068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8c960a78-bd09-40d9-be45-6630b5e02347 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1322 microversion: 2.1 time: 0.546942 May 13 13:23:40.490329 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 50/95] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:39 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1322 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:40.657742 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-a8031f4d-aa83-4c6f-9f42-dc36de8d6128 req-0535bd80-9be6-49ca-b166-f85fa1eaf0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e075348c-c206-4d9a-bfdd-a62857c07dec", "name": "network-vif-plugged", "status": "completed", "tag": "0f02d863-38e9-4d24-99ba-89d714b38cb6"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:23:40.678080 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-a8031f4d-aa83-4c6f-9f42-dc36de8d6128 req-0535bd80-9be6-49ca-b166-f85fa1eaf0e9 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:40.682733 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-a8031f4d-aa83-4c6f-9f42-dc36de8d6128 req-0535bd80-9be6-49ca-b166-f85fa1eaf0e9 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:40.696041 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-a8031f4d-aa83-4c6f-9f42-dc36de8d6128 req-0535bd80-9be6-49ca-b166-f85fa1eaf0e9 service nova] Creating event network-vif-plugged:0f02d863-38e9-4d24-99ba-89d714b38cb6 for instance e075348c-c206-4d9a-bfdd-a62857c07dec on hv-cinder-84163 May 13 13:23:40.702749 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-a8031f4d-aa83-4c6f-9f42-dc36de8d6128 req-0535bd80-9be6-49ca-b166-f85fa1eaf0e9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049505 May 13 13:23:40.703629 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 46/96] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:40.775717 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-3e77312c-6349-4029-b77c-73b8618d73ce req-d9d7f039-6890-4b37-b933-e2be964fef93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6", "tag": "c523458e-8e82-46df-bfae-db11fc8b2ec5"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:23:40.790840 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-3e77312c-6349-4029-b77c-73b8618d73ce req-d9d7f039-6890-4b37-b933-e2be964fef93 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:40.791289 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-3e77312c-6349-4029-b77c-73b8618d73ce req-d9d7f039-6890-4b37-b933-e2be964fef93 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:40.816562 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-3e77312c-6349-4029-b77c-73b8618d73ce req-d9d7f039-6890-4b37-b933-e2be964fef93 service nova] Creating event network-changed:c523458e-8e82-46df-bfae-db11fc8b2ec5 for instance 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 on hv-cinder-84163 May 13 13:23:40.825002 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-3e77312c-6349-4029-b77c-73b8618d73ce req-d9d7f039-6890-4b37-b933-e2be964fef93 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053115 May 13 13:23:40.827275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 51/97] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:40.877645 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a240b0ce-090b-48b5-9b50-1f27e4de8720 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:40.877645 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a240b0ce-090b-48b5-9b50-1f27e4de8720 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:40.886229 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a240b0ce-090b-48b5-9b50-1f27e4de8720 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:40.886922 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a240b0ce-090b-48b5-9b50-1f27e4de8720 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:40.889215 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a240b0ce-090b-48b5-9b50-1f27e4de8720 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:40.890676 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a240b0ce-090b-48b5-9b50-1f27e4de8720 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:40.915101 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-099de492-77b6-427b-8c09-04046b6a4d87 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:40.915804 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-099de492-77b6-427b-8c09-04046b6a4d87 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:40.929159 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-099de492-77b6-427b-8c09-04046b6a4d87 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:40.929802 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-099de492-77b6-427b-8c09-04046b6a4d87 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:40.933393 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-099de492-77b6-427b-8c09-04046b6a4d87 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:40.935193 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-099de492-77b6-427b-8c09-04046b6a4d87 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:41.257498 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a240b0ce-090b-48b5-9b50-1f27e4de8720 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:41.277398 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-099de492-77b6-427b-8c09-04046b6a4d87 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:41.285009 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-099de492-77b6-427b-8c09-04046b6a4d87 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1362 microversion: 2.1 time: 0.375700 May 13 13:23:41.285558 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a240b0ce-090b-48b5-9b50-1f27e4de8720 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1315 microversion: 2.1 time: 0.409680 May 13 13:23:41.286189 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 47/98] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:40 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:41.287001 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 52/99] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:40 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1362 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:23:41.465184 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9bca88e3-a1eb-429c-8394-7d60f95e9e94 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:41.467755 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9bca88e3-a1eb-429c-8394-7d60f95e9e94 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:41.477707 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9bca88e3-a1eb-429c-8394-7d60f95e9e94 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:41.478671 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9bca88e3-a1eb-429c-8394-7d60f95e9e94 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:41.480122 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9bca88e3-a1eb-429c-8394-7d60f95e9e94 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:41.481084 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9bca88e3-a1eb-429c-8394-7d60f95e9e94 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:41.506046 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4d047269-43cb-4f99-85c3-3f4701c3e125 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:41.506804 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4d047269-43cb-4f99-85c3-3f4701c3e125 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:41.513109 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4d047269-43cb-4f99-85c3-3f4701c3e125 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:41.514664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4d047269-43cb-4f99-85c3-3f4701c3e125 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:41.515618 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4d047269-43cb-4f99-85c3-3f4701c3e125 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:41.516201 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4d047269-43cb-4f99-85c3-3f4701c3e125 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:41.958848 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9bca88e3-a1eb-429c-8394-7d60f95e9e94 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:41.969312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9bca88e3-a1eb-429c-8394-7d60f95e9e94 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:41.970678 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9bca88e3-a1eb-429c-8394-7d60f95e9e94 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:41.972326 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9bca88e3-a1eb-429c-8394-7d60f95e9e94 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1408 microversion: 2.20 time: 0.514027 May 13 13:23:41.986871 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 48/100] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:23:41 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1408 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:23:42.001263 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4d047269-43cb-4f99-85c3-3f4701c3e125 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:42.012011 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4d047269-43cb-4f99-85c3-3f4701c3e125 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1322 microversion: 2.1 time: 0.509796 May 13 13:23:42.012902 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 53/101] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:41 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1322 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:23:42.318595 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e6f42150-35c3-407d-a4b0-de202ddf669c tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:42.319065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6649dbe6-b8a8-46e3-a1b2-b2d34f366182 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:42.319934 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6649dbe6-b8a8-46e3-a1b2-b2d34f366182 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:42.320897 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e6f42150-35c3-407d-a4b0-de202ddf669c tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:42.346897 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e6f42150-35c3-407d-a4b0-de202ddf669c tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:42.354319 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6649dbe6-b8a8-46e3-a1b2-b2d34f366182 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:42.354764 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e6f42150-35c3-407d-a4b0-de202ddf669c tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:42.355582 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6649dbe6-b8a8-46e3-a1b2-b2d34f366182 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:42.360361 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e6f42150-35c3-407d-a4b0-de202ddf669c tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:42.363161 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e6f42150-35c3-407d-a4b0-de202ddf669c tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:42.365680 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6649dbe6-b8a8-46e3-a1b2-b2d34f366182 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:42.368042 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6649dbe6-b8a8-46e3-a1b2-b2d34f366182 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:42.820621 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e6f42150-35c3-407d-a4b0-de202ddf669c tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:42.830668 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e6f42150-35c3-407d-a4b0-de202ddf669c tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1502 microversion: 2.1 time: 0.523159 May 13 13:23:42.831268 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 49/102] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:42 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1502 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:42.849886 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-794d569a-f1b8-47ac-ae44-efb911488a0b req-1b5b5f47-31a2-4d6d-a2ea-9c489ee4cc2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75885842-8f4b-43a8-aa30-0da326e4f6e3", "name": "network-vif-plugged", "status": "completed", "tag": "da8f9c78-af27-45b6-9aff-0e4aa45c7266"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:23:42.868329 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-794d569a-f1b8-47ac-ae44-efb911488a0b req-1b5b5f47-31a2-4d6d-a2ea-9c489ee4cc2e service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:42.868779 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-794d569a-f1b8-47ac-ae44-efb911488a0b req-1b5b5f47-31a2-4d6d-a2ea-9c489ee4cc2e service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:42.880222 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6649dbe6-b8a8-46e3-a1b2-b2d34f366182 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:42.890745 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6649dbe6-b8a8-46e3-a1b2-b2d34f366182 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1362 microversion: 2.1 time: 0.580302 May 13 13:23:42.891192 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-794d569a-f1b8-47ac-ae44-efb911488a0b req-1b5b5f47-31a2-4d6d-a2ea-9c489ee4cc2e service nova] Creating event network-vif-plugged:da8f9c78-af27-45b6-9aff-0e4aa45c7266 for instance 75885842-8f4b-43a8-aa30-0da326e4f6e3 on hv-cinder-84163 May 13 13:23:42.891932 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 54/103] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:42 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1362 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:42.906673 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-794d569a-f1b8-47ac-ae44-efb911488a0b req-1b5b5f47-31a2-4d6d-a2ea-9c489ee4cc2e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072339 May 13 13:23:42.908546 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 50/104] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:42.991737 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5ae3f2e6-19ea-4971-aeb5-ecf34166144a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:42.992343 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5ae3f2e6-19ea-4971-aeb5-ecf34166144a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:43.000069 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5ae3f2e6-19ea-4971-aeb5-ecf34166144a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:43.000069 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5ae3f2e6-19ea-4971-aeb5-ecf34166144a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:43.000799 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5ae3f2e6-19ea-4971-aeb5-ecf34166144a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:43.001400 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5ae3f2e6-19ea-4971-aeb5-ecf34166144a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:43.037011 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-10b09722-1dc0-4f6b-9834-5d0fb6b3768d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:43.044872 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-10b09722-1dc0-4f6b-9834-5d0fb6b3768d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:43.064537 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-10b09722-1dc0-4f6b-9834-5d0fb6b3768d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:43.066955 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-10b09722-1dc0-4f6b-9834-5d0fb6b3768d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:43.068294 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-10b09722-1dc0-4f6b-9834-5d0fb6b3768d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:43.068916 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-10b09722-1dc0-4f6b-9834-5d0fb6b3768d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:43.361130 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5ae3f2e6-19ea-4971-aeb5-ecf34166144a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:43.372584 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5ae3f2e6-19ea-4971-aeb5-ecf34166144a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:43.374853 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5ae3f2e6-19ea-4971-aeb5-ecf34166144a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:43.375936 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5ae3f2e6-19ea-4971-aeb5-ecf34166144a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1408 microversion: 2.20 time: 0.388260 May 13 13:23:43.382446 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 55/105] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:23:42 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1408 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:23:43.412120 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-10b09722-1dc0-4f6b-9834-5d0fb6b3768d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:43.422567 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-10b09722-1dc0-4f6b-9834-5d0fb6b3768d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1322 microversion: 2.1 time: 0.396310 May 13 13:23:43.425630 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 51/106] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:43 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1322 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:23:43.909754 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-90525342-5c5b-438b-b9cb-52396da5a470 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:43.910632 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-90525342-5c5b-438b-b9cb-52396da5a470 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:43.917333 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-90525342-5c5b-438b-b9cb-52396da5a470 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:43.918110 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-90525342-5c5b-438b-b9cb-52396da5a470 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:43.920034 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-90525342-5c5b-438b-b9cb-52396da5a470 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:43.921402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-90525342-5c5b-438b-b9cb-52396da5a470 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:44.198920 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-90525342-5c5b-438b-b9cb-52396da5a470 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:44.210245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-90525342-5c5b-438b-b9cb-52396da5a470 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1362 microversion: 2.1 time: 0.304594 May 13 13:23:44.211100 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 56/107] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:43 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1362 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:44.399011 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4f33aac0-fa59-45d9-85a7-36bfc8d6a605 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:44.400049 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4f33aac0-fa59-45d9-85a7-36bfc8d6a605 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:44.408428 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4f33aac0-fa59-45d9-85a7-36bfc8d6a605 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:44.409311 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4f33aac0-fa59-45d9-85a7-36bfc8d6a605 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:44.410341 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4f33aac0-fa59-45d9-85a7-36bfc8d6a605 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:44.410996 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4f33aac0-fa59-45d9-85a7-36bfc8d6a605 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:44.441414 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-342e4c0b-e349-4232-a630-fc644158dcd2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:44.442028 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-342e4c0b-e349-4232-a630-fc644158dcd2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:44.452961 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-342e4c0b-e349-4232-a630-fc644158dcd2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:44.453775 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-342e4c0b-e349-4232-a630-fc644158dcd2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:44.454786 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-342e4c0b-e349-4232-a630-fc644158dcd2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:44.457557 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-342e4c0b-e349-4232-a630-fc644158dcd2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:44.729430 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-342e4c0b-e349-4232-a630-fc644158dcd2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:44.740731 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-342e4c0b-e349-4232-a630-fc644158dcd2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1322 microversion: 2.1 time: 0.302995 May 13 13:23:44.741599 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 57/108] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:44 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:23:44.745509 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4f33aac0-fa59-45d9-85a7-36bfc8d6a605 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:44.757487 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4f33aac0-fa59-45d9-85a7-36bfc8d6a605 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:44.759214 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4f33aac0-fa59-45d9-85a7-36bfc8d6a605 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:44.760467 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4f33aac0-fa59-45d9-85a7-36bfc8d6a605 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1408 microversion: 2.20 time: 0.368430 May 13 13:23:44.761167 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 52/109] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:23:44 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1408 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:23:44.899447 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-fce1d97c-3b02-468c-83be-2baba0ba5469 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19907851-22d0-4d36-a376-f8300b576514"}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:23:44.900803 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-fce1d97c-3b02-468c-83be-2baba0ba5469 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:44.907115 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fce1d97c-3b02-468c-83be-2baba0ba5469 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:44.907581 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fce1d97c-3b02-468c-83be-2baba0ba5469 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:44.908385 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fce1d97c-3b02-468c-83be-2baba0ba5469 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:44.908803 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fce1d97c-3b02-468c-83be-2baba0ba5469 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:44.928410 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-0cfdb4ab-4fa7-416b-a6ea-9b6c7bfa8293 req-eeeb950b-35ee-4569-9989-55d87e37d6a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2c2709-a695-4f16-a0fa-fed674cfab86", "name": "network-vif-plugged", "status": "completed", "tag": "bb022415-b3c9-4b44-a6e4-3190a75170e0"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:23:44.937800 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-0cfdb4ab-4fa7-416b-a6ea-9b6c7bfa8293 req-eeeb950b-35ee-4569-9989-55d87e37d6a8 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:44.938279 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-0cfdb4ab-4fa7-416b-a6ea-9b6c7bfa8293 req-eeeb950b-35ee-4569-9989-55d87e37d6a8 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:44.950386 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-0cfdb4ab-4fa7-416b-a6ea-9b6c7bfa8293 req-eeeb950b-35ee-4569-9989-55d87e37d6a8 service nova] Creating event network-vif-plugged:bb022415-b3c9-4b44-a6e4-3190a75170e0 for instance 3b2c2709-a695-4f16-a0fa-fed674cfab86 on hv-cinder-84163 May 13 13:23:44.957071 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-0cfdb4ab-4fa7-416b-a6ea-9b6c7bfa8293 req-eeeb950b-35ee-4569-9989-55d87e37d6a8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032433 May 13 13:23:44.958263 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 53/110] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:23:45.235046 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-36409c5b-7c9f-4cd9-ad16-78afc468ae59 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:45.236232 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-36409c5b-7c9f-4cd9-ad16-78afc468ae59 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:45.245567 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-36409c5b-7c9f-4cd9-ad16-78afc468ae59 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:45.246833 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-36409c5b-7c9f-4cd9-ad16-78afc468ae59 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:45.249703 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-36409c5b-7c9f-4cd9-ad16-78afc468ae59 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:45.250676 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-36409c5b-7c9f-4cd9-ad16-78afc468ae59 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:45.416601 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-36409c5b-7c9f-4cd9-ad16-78afc468ae59 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:45.425729 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-36409c5b-7c9f-4cd9-ad16-78afc468ae59 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1362 microversion: 2.1 time: 0.196646 May 13 13:23:45.426354 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 54/111] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:45 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:23:45.766624 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-dc6f517b-3dd2-405f-a8e3-bdd7a1566942 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:45.778726 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-dc6f517b-3dd2-405f-a8e3-bdd7a1566942 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:45.807667 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dc6f517b-3dd2-405f-a8e3-bdd7a1566942 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:45.812400 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dc6f517b-3dd2-405f-a8e3-bdd7a1566942 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:45.815888 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dc6f517b-3dd2-405f-a8e3-bdd7a1566942 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:45.820621 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dc6f517b-3dd2-405f-a8e3-bdd7a1566942 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:46.056228 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dc6f517b-3dd2-405f-a8e3-bdd7a1566942 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:46.080023 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-dc6f517b-3dd2-405f-a8e3-bdd7a1566942 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1517 microversion: 2.1 time: 0.318268 May 13 13:23:46.080958 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 55/112] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:45 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1517 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:23:46.091098 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9144691b-a383-4200-8b17-4e7ca45108c9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:46.095687 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9144691b-a383-4200-8b17-4e7ca45108c9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:46.105511 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9144691b-a383-4200-8b17-4e7ca45108c9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:46.106118 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9144691b-a383-4200-8b17-4e7ca45108c9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:46.108622 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9144691b-a383-4200-8b17-4e7ca45108c9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:46.109547 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9144691b-a383-4200-8b17-4e7ca45108c9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:46.369350 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9144691b-a383-4200-8b17-4e7ca45108c9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:46.382114 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9144691b-a383-4200-8b17-4e7ca45108c9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:46.385030 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9144691b-a383-4200-8b17-4e7ca45108c9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:46.387188 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9144691b-a383-4200-8b17-4e7ca45108c9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1408 microversion: 2.20 time: 0.304742 May 13 13:23:46.387904 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 56/113] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:23:46 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1408 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:23:46.398683 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0f3ebe1d-ff9b-4bee-ab5d-84d696c712ba tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:23:46.401058 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0f3ebe1d-ff9b-4bee-ab5d-84d696c712ba tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:46.426745 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0f3ebe1d-ff9b-4bee-ab5d-84d696c712ba tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:46.429926 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0f3ebe1d-ff9b-4bee-ab5d-84d696c712ba tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:46.431654 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0f3ebe1d-ff9b-4bee-ab5d-84d696c712ba tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:46.432248 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0f3ebe1d-ff9b-4bee-ab5d-84d696c712ba tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:46.568261 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-0f3ebe1d-ff9b-4bee-ab5d-84d696c712ba tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lazy-loading 'flavor' on Instance uuid e075348c-c206-4d9a-bfdd-a62857c07dec {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:23:47.066042 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0f3ebe1d-ff9b-4bee-ab5d-84d696c712ba tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "POST /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec/action" status: 200 len: 32 microversion: 2.1 time: 0.675604 May 13 13:23:47.068041 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 57/114] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 13 13:23:46 2022] POST /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec/action => generated 32 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 13:23:47.068472 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-fce1d97c-3b02-468c-83be-2baba0ba5469 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "POST /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.172274 May 13 13:23:47.079162 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3a2cdc0d-6f5d-41ea-a1fb-c2d9d76bd519 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:47.079911 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3a2cdc0d-6f5d-41ea-a1fb-c2d9d76bd519 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:47.088200 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 58/115] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 13 13:23:44 2022] POST /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff/os-volume_attachments => generated 194 bytes in 2193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:47.107218 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3a2cdc0d-6f5d-41ea-a1fb-c2d9d76bd519 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:47.107218 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3a2cdc0d-6f5d-41ea-a1fb-c2d9d76bd519 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:47.107218 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3a2cdc0d-6f5d-41ea-a1fb-c2d9d76bd519 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:47.107218 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3a2cdc0d-6f5d-41ea-a1fb-c2d9d76bd519 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:47.116911 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e506be6a-081a-44ad-a6d3-439bf307ce91 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:47.123199 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e506be6a-081a-44ad-a6d3-439bf307ce91 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:47.161529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e506be6a-081a-44ad-a6d3-439bf307ce91 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:47.167830 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e506be6a-081a-44ad-a6d3-439bf307ce91 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:47.168915 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e506be6a-081a-44ad-a6d3-439bf307ce91 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:47.177460 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e506be6a-081a-44ad-a6d3-439bf307ce91 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:47.555605 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3a2cdc0d-6f5d-41ea-a1fb-c2d9d76bd519 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:47.563686 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3a2cdc0d-6f5d-41ea-a1fb-c2d9d76bd519 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1362 microversion: 2.1 time: 0.495521 May 13 13:23:47.564276 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 58/116] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:47 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1362 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:47.577592 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9a78b245-e4c2-416e-ba7e-e9cad2e7f42f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:47.578589 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9a78b245-e4c2-416e-ba7e-e9cad2e7f42f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:47.595180 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9a78b245-e4c2-416e-ba7e-e9cad2e7f42f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:47.598958 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9a78b245-e4c2-416e-ba7e-e9cad2e7f42f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:47.599957 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9a78b245-e4c2-416e-ba7e-e9cad2e7f42f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:47.600543 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9a78b245-e4c2-416e-ba7e-e9cad2e7f42f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:47.600886 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e506be6a-081a-44ad-a6d3-439bf307ce91 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:47.623947 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e506be6a-081a-44ad-a6d3-439bf307ce91 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.530756 May 13 13:23:47.648409 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 59/117] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:47 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:47.802632 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9a78b245-e4c2-416e-ba7e-e9cad2e7f42f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:47.815034 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9a78b245-e4c2-416e-ba7e-e9cad2e7f42f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:47.816580 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9a78b245-e4c2-416e-ba7e-e9cad2e7f42f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:47.817835 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9a78b245-e4c2-416e-ba7e-e9cad2e7f42f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1408 microversion: 2.20 time: 0.252465 May 13 13:23:47.823086 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 59/118] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:23:47 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:23:48.602169 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-df7763d4-c84e-4922-ad9d-2b256b136287 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:48.606274 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-df7763d4-c84e-4922-ad9d-2b256b136287 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:48.642457 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df7763d4-c84e-4922-ad9d-2b256b136287 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:48.646391 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df7763d4-c84e-4922-ad9d-2b256b136287 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:48.646391 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df7763d4-c84e-4922-ad9d-2b256b136287 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:48.647380 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df7763d4-c84e-4922-ad9d-2b256b136287 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:48.679557 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-680c85fa-fd6f-4916-bcd9-1e500f29d6a8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:48.680581 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-680c85fa-fd6f-4916-bcd9-1e500f29d6a8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:48.700950 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-680c85fa-fd6f-4916-bcd9-1e500f29d6a8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:48.702223 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-680c85fa-fd6f-4916-bcd9-1e500f29d6a8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:48.703186 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-680c85fa-fd6f-4916-bcd9-1e500f29d6a8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:48.703620 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-680c85fa-fd6f-4916-bcd9-1e500f29d6a8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:48.987252 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-df7763d4-c84e-4922-ad9d-2b256b136287 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:48.999171 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-680c85fa-fd6f-4916-bcd9-1e500f29d6a8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:49.012118 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-df7763d4-c84e-4922-ad9d-2b256b136287 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1548 microversion: 2.1 time: 0.417570 May 13 13:23:49.013235 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 60/119] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:48 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1548 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:49.016167 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-680c85fa-fd6f-4916-bcd9-1e500f29d6a8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.345107 May 13 13:23:49.018193 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 60/120] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:48 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:49.023508 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-b1843c61-8166-4666-a5a2-e2fe5075fea4 req-fa307d36-e168-46bc-be5a-bcb12d607e2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6", "name": "network-vif-plugged", "status": "completed", "tag": "c523458e-8e82-46df-bfae-db11fc8b2ec5"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:23:49.033529 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-721a3834-2c32-4ecc-9cba-2c53ebfe15e3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:49.036809 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-721a3834-2c32-4ecc-9cba-2c53ebfe15e3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:49.050135 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-b1843c61-8166-4666-a5a2-e2fe5075fea4 req-fa307d36-e168-46bc-be5a-bcb12d607e2e service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:49.052419 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-b1843c61-8166-4666-a5a2-e2fe5075fea4 req-fa307d36-e168-46bc-be5a-bcb12d607e2e service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:49.056325 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-721a3834-2c32-4ecc-9cba-2c53ebfe15e3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:49.056852 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-721a3834-2c32-4ecc-9cba-2c53ebfe15e3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:49.058577 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-721a3834-2c32-4ecc-9cba-2c53ebfe15e3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:49.059373 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-721a3834-2c32-4ecc-9cba-2c53ebfe15e3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:49.071293 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-b1843c61-8166-4666-a5a2-e2fe5075fea4 req-fa307d36-e168-46bc-be5a-bcb12d607e2e service nova] Creating event network-vif-plugged:c523458e-8e82-46df-bfae-db11fc8b2ec5 for instance 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 on hv-cinder-84163 May 13 13:23:49.076181 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-b1843c61-8166-4666-a5a2-e2fe5075fea4 req-fa307d36-e168-46bc-be5a-bcb12d607e2e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060209 May 13 13:23:49.077145 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 61/121] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:49.082861 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5c21f568-c5f5-4dff-8470-175c5448e197 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:49.083641 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5c21f568-c5f5-4dff-8470-175c5448e197 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:49.101345 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5c21f568-c5f5-4dff-8470-175c5448e197 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:49.101982 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5c21f568-c5f5-4dff-8470-175c5448e197 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:49.102851 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5c21f568-c5f5-4dff-8470-175c5448e197 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:49.103413 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5c21f568-c5f5-4dff-8470-175c5448e197 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:49.288141 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5c21f568-c5f5-4dff-8470-175c5448e197 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.209679 May 13 13:23:49.290251 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 62/122] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 13 13:23:49 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86/os-interface => generated 285 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:49.405661 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-721a3834-2c32-4ecc-9cba-2c53ebfe15e3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:49.423209 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-721a3834-2c32-4ecc-9cba-2c53ebfe15e3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:49.424969 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-721a3834-2c32-4ecc-9cba-2c53ebfe15e3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:49.426655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-721a3834-2c32-4ecc-9cba-2c53ebfe15e3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1408 microversion: 2.20 time: 0.406544 May 13 13:23:49.427928 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 61/123] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:23:49 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1408 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:23:50.039310 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-16d1924e-3f4d-4cd6-89f3-572b7faf95fe tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:50.040836 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-16d1924e-3f4d-4cd6-89f3-572b7faf95fe tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:50.049955 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-16d1924e-3f4d-4cd6-89f3-572b7faf95fe tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:50.050501 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-16d1924e-3f4d-4cd6-89f3-572b7faf95fe tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:50.051289 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-16d1924e-3f4d-4cd6-89f3-572b7faf95fe tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:50.051714 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-16d1924e-3f4d-4cd6-89f3-572b7faf95fe tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:50.272734 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-16d1924e-3f4d-4cd6-89f3-572b7faf95fe tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:50.283051 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-16d1924e-3f4d-4cd6-89f3-572b7faf95fe tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.249485 May 13 13:23:50.283920 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 63/124] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:50 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:50.450707 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-23dd0b78-5cfa-4165-88d5-b0d32c7e5245 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:50.464194 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-23dd0b78-5cfa-4165-88d5-b0d32c7e5245 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:50.475576 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-23dd0b78-5cfa-4165-88d5-b0d32c7e5245 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:50.476537 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-23dd0b78-5cfa-4165-88d5-b0d32c7e5245 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:50.478571 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-23dd0b78-5cfa-4165-88d5-b0d32c7e5245 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:50.479364 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-23dd0b78-5cfa-4165-88d5-b0d32c7e5245 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:50.756989 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-23dd0b78-5cfa-4165-88d5-b0d32c7e5245 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:50.768447 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-23dd0b78-5cfa-4165-88d5-b0d32c7e5245 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:50.774484 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-23dd0b78-5cfa-4165-88d5-b0d32c7e5245 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:50.777227 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-23dd0b78-5cfa-4165-88d5-b0d32c7e5245 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1408 microversion: 2.20 time: 0.335529 May 13 13:23:50.779967 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 62/125] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:23:50 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1408 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:23:51.205159 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-84ad8212-a3fd-427f-8e73-80fad97f880c req-399187b4-09f8-4ca4-9fea-3dd291a5b773 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b2c2709-a695-4f16-a0fa-fed674cfab86", "tag": "bb022415-b3c9-4b44-a6e4-3190a75170e0"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:23:51.226702 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-84ad8212-a3fd-427f-8e73-80fad97f880c req-399187b4-09f8-4ca4-9fea-3dd291a5b773 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:51.227146 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-84ad8212-a3fd-427f-8e73-80fad97f880c req-399187b4-09f8-4ca4-9fea-3dd291a5b773 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:51.251465 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-84ad8212-a3fd-427f-8e73-80fad97f880c req-399187b4-09f8-4ca4-9fea-3dd291a5b773 service nova] Creating event network-changed:bb022415-b3c9-4b44-a6e4-3190a75170e0 for instance 3b2c2709-a695-4f16-a0fa-fed674cfab86 on hv-cinder-84163 May 13 13:23:51.257861 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-84ad8212-a3fd-427f-8e73-80fad97f880c req-399187b4-09f8-4ca4-9fea-3dd291a5b773 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059506 May 13 13:23:51.259670 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 64/126] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:51.307437 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c5f26672-02cd-475c-98f0-48ac09afa34d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:51.308587 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c5f26672-02cd-475c-98f0-48ac09afa34d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:51.321297 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c5f26672-02cd-475c-98f0-48ac09afa34d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:51.322647 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c5f26672-02cd-475c-98f0-48ac09afa34d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:51.324635 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c5f26672-02cd-475c-98f0-48ac09afa34d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:51.325622 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c5f26672-02cd-475c-98f0-48ac09afa34d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:51.687676 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c5f26672-02cd-475c-98f0-48ac09afa34d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:51.707621 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c5f26672-02cd-475c-98f0-48ac09afa34d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.407669 May 13 13:23:51.709067 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 63/127] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:51 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:51.802252 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-73abc638-24b2-4666-bf0d-52bf5f1b9b00 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:51.807114 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-73abc638-24b2-4666-bf0d-52bf5f1b9b00 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:51.831046 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73abc638-24b2-4666-bf0d-52bf5f1b9b00 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:51.831808 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73abc638-24b2-4666-bf0d-52bf5f1b9b00 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:51.839176 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73abc638-24b2-4666-bf0d-52bf5f1b9b00 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:51.844237 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73abc638-24b2-4666-bf0d-52bf5f1b9b00 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:52.155333 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-73abc638-24b2-4666-bf0d-52bf5f1b9b00 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:52.167694 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-73abc638-24b2-4666-bf0d-52bf5f1b9b00 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:52.169541 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-73abc638-24b2-4666-bf0d-52bf5f1b9b00 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:52.173685 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-73abc638-24b2-4666-bf0d-52bf5f1b9b00 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1600 microversion: 2.20 time: 0.377249 May 13 13:23:52.174456 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 65/128] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:23:51 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1600 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:23:52.197643 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f848e1b0-2175-4bc1-86dd-8fd774103e25 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:52.198144 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f848e1b0-2175-4bc1-86dd-8fd774103e25 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:52.210273 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f848e1b0-2175-4bc1-86dd-8fd774103e25 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:52.210913 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f848e1b0-2175-4bc1-86dd-8fd774103e25 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:52.211886 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f848e1b0-2175-4bc1-86dd-8fd774103e25 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:52.212321 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f848e1b0-2175-4bc1-86dd-8fd774103e25 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:52.338642 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f848e1b0-2175-4bc1-86dd-8fd774103e25 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.148774 May 13 13:23:52.339437 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 64/129] 10.222.0.13 () {60 vars in 1315 bytes} [Fri May 13 13:23:52 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6/os-interface => generated 285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 13:23:52.727145 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-18406439-0b2f-4dab-a838-8f6cc3e272a9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:52.728304 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-18406439-0b2f-4dab-a838-8f6cc3e272a9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:52.739693 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-18406439-0b2f-4dab-a838-8f6cc3e272a9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:52.740151 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-18406439-0b2f-4dab-a838-8f6cc3e272a9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:52.741494 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-18406439-0b2f-4dab-a838-8f6cc3e272a9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:52.742353 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-18406439-0b2f-4dab-a838-8f6cc3e272a9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:53.040998 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-18406439-0b2f-4dab-a838-8f6cc3e272a9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:53.052332 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-18406439-0b2f-4dab-a838-8f6cc3e272a9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.329539 May 13 13:23:53.053419 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 66/130] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:52 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:54.050500 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-afe0ad02-69f2-49d1-b8e8-4f665933fe0d req-7f46bde0-c111-4aab-a106-c843861fc269 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6", "tag": "c523458e-8e82-46df-bfae-db11fc8b2ec5"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:23:54.063676 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-afe0ad02-69f2-49d1-b8e8-4f665933fe0d req-7f46bde0-c111-4aab-a106-c843861fc269 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:54.066272 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-afe0ad02-69f2-49d1-b8e8-4f665933fe0d req-7f46bde0-c111-4aab-a106-c843861fc269 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:54.071946 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-431b7347-1b71-4a3d-8ba0-f64dc68178bb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:54.073828 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-431b7347-1b71-4a3d-8ba0-f64dc68178bb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:54.084062 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-431b7347-1b71-4a3d-8ba0-f64dc68178bb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:54.084961 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-431b7347-1b71-4a3d-8ba0-f64dc68178bb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:54.085950 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-431b7347-1b71-4a3d-8ba0-f64dc68178bb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:54.086561 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-431b7347-1b71-4a3d-8ba0-f64dc68178bb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:54.093234 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-afe0ad02-69f2-49d1-b8e8-4f665933fe0d req-7f46bde0-c111-4aab-a106-c843861fc269 service nova] Creating event network-changed:c523458e-8e82-46df-bfae-db11fc8b2ec5 for instance 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 on hv-cinder-84163 May 13 13:23:54.102959 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-afe0ad02-69f2-49d1-b8e8-4f665933fe0d req-7f46bde0-c111-4aab-a106-c843861fc269 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057117 May 13 13:23:54.104514 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 65/131] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:54.246489 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-431b7347-1b71-4a3d-8ba0-f64dc68178bb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:54.254959 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-431b7347-1b71-4a3d-8ba0-f64dc68178bb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.187159 May 13 13:23:54.255754 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 67/132] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:54 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:23:55.279568 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-cf223add-383d-4423-a0df-f05ca0a19de9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:55.280449 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-cf223add-383d-4423-a0df-f05ca0a19de9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:55.287214 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cf223add-383d-4423-a0df-f05ca0a19de9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:55.287876 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cf223add-383d-4423-a0df-f05ca0a19de9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:55.289150 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cf223add-383d-4423-a0df-f05ca0a19de9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:55.289795 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cf223add-383d-4423-a0df-f05ca0a19de9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:55.577564 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-cf223add-383d-4423-a0df-f05ca0a19de9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:55.589215 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-cf223add-383d-4423-a0df-f05ca0a19de9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.314031 May 13 13:23:55.589809 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 66/133] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:55 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:56.613792 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b03cadec-2cb4-45c8-b790-575c99832ba8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:56.614643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b03cadec-2cb4-45c8-b790-575c99832ba8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:56.625481 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b03cadec-2cb4-45c8-b790-575c99832ba8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:56.626053 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b03cadec-2cb4-45c8-b790-575c99832ba8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:56.626965 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b03cadec-2cb4-45c8-b790-575c99832ba8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:56.627580 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b03cadec-2cb4-45c8-b790-575c99832ba8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:56.769211 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b03cadec-2cb4-45c8-b790-575c99832ba8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:56.778158 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b03cadec-2cb4-45c8-b790-575c99832ba8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.167880 May 13 13:23:56.779054 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 68/134] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:56 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:57.527535 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-86545b20-8978-474d-a9df-491695762b11 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:57.528118 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-86545b20-8978-474d-a9df-491695762b11 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:57.536069 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-86545b20-8978-474d-a9df-491695762b11 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:57.536543 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-86545b20-8978-474d-a9df-491695762b11 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:57.537758 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-86545b20-8978-474d-a9df-491695762b11 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:57.539836 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-86545b20-8978-474d-a9df-491695762b11 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:57.586724 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-86545b20-8978-474d-a9df-491695762b11 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Going to try to terminate instance {{(pid=117720) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:23:57.797852 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c9b81e5e-9d5f-455b-8a7c-2220570799e1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:57.798475 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c9b81e5e-9d5f-455b-8a7c-2220570799e1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:57.805142 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c9b81e5e-9d5f-455b-8a7c-2220570799e1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:57.805590 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c9b81e5e-9d5f-455b-8a7c-2220570799e1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:57.806455 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c9b81e5e-9d5f-455b-8a7c-2220570799e1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:57.806888 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c9b81e5e-9d5f-455b-8a7c-2220570799e1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:57.963066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c9b81e5e-9d5f-455b-8a7c-2220570799e1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:57.973995 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c9b81e5e-9d5f-455b-8a7c-2220570799e1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.180604 May 13 13:23:57.983980 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 69/135] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:57 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:23:58.102397 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-86545b20-8978-474d-a9df-491695762b11 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "DELETE /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 204 len: 0 microversion: 2.1 time: 0.578533 May 13 13:23:58.103164 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 67/136] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:23:57 2022] DELETE /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 0 bytes in 580 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:23:58.113309 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3db7d2e5-0972-467e-b6af-619822039ef2 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:58.114139 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3db7d2e5-0972-467e-b6af-619822039ef2 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:58.120472 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3db7d2e5-0972-467e-b6af-619822039ef2 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:58.120911 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3db7d2e5-0972-467e-b6af-619822039ef2 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:58.121669 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3db7d2e5-0972-467e-b6af-619822039ef2 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:58.122308 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3db7d2e5-0972-467e-b6af-619822039ef2 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:58.260606 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3db7d2e5-0972-467e-b6af-619822039ef2 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:58.269063 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3db7d2e5-0972-467e-b6af-619822039ef2 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1554 microversion: 2.1 time: 0.159584 May 13 13:23:58.269650 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 70/137] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:58 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:23:58.992915 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-01e82b9e-c629-471d-9a4e-5bba8b5fc451 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:58.993614 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-01e82b9e-c629-471d-9a4e-5bba8b5fc451 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:59.001163 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-01e82b9e-c629-471d-9a4e-5bba8b5fc451 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:59.001611 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-01e82b9e-c629-471d-9a4e-5bba8b5fc451 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:59.002413 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-01e82b9e-c629-471d-9a4e-5bba8b5fc451 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:59.002937 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-01e82b9e-c629-471d-9a4e-5bba8b5fc451 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:59.227964 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-01e82b9e-c629-471d-9a4e-5bba8b5fc451 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:59.238103 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-01e82b9e-c629-471d-9a4e-5bba8b5fc451 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.249410 May 13 13:23:59.238765 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 68/138] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:58 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:23:59.288737 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f9f0b6d3-8b9c-4a5f-9410-88fdcf2ccce2 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:59.289635 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f9f0b6d3-8b9c-4a5f-9410-88fdcf2ccce2 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:23:59.296999 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f9f0b6d3-8b9c-4a5f-9410-88fdcf2ccce2 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:59.300255 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f9f0b6d3-8b9c-4a5f-9410-88fdcf2ccce2 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:59.300255 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f9f0b6d3-8b9c-4a5f-9410-88fdcf2ccce2 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:59.300255 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f9f0b6d3-8b9c-4a5f-9410-88fdcf2ccce2 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:59.474559 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f9f0b6d3-8b9c-4a5f-9410-88fdcf2ccce2 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:23:59.483344 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f9f0b6d3-8b9c-4a5f-9410-88fdcf2ccce2 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1554 microversion: 2.1 time: 0.199611 May 13 13:23:59.483941 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 71/139] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:23:59 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1554 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:00.263646 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e012e977-cfb4-46b5-941c-b4e8f1e6948d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:00.265693 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e012e977-cfb4-46b5-941c-b4e8f1e6948d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:00.272151 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e012e977-cfb4-46b5-941c-b4e8f1e6948d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:00.272603 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e012e977-cfb4-46b5-941c-b4e8f1e6948d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:00.273379 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e012e977-cfb4-46b5-941c-b4e8f1e6948d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:00.273811 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e012e977-cfb4-46b5-941c-b4e8f1e6948d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:00.505365 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-829c0a31-42ef-463b-b691-1def5dafbed3 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:00.506130 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-829c0a31-42ef-463b-b691-1def5dafbed3 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:00.514222 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e012e977-cfb4-46b5-941c-b4e8f1e6948d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:00.518879 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-829c0a31-42ef-463b-b691-1def5dafbed3 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:00.519436 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-829c0a31-42ef-463b-b691-1def5dafbed3 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:00.520312 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-829c0a31-42ef-463b-b691-1def5dafbed3 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:00.520817 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-829c0a31-42ef-463b-b691-1def5dafbed3 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:00.522147 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e012e977-cfb4-46b5-941c-b4e8f1e6948d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.262300 May 13 13:24:00.522836 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 69/140] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:00 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:00.658696 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-829c0a31-42ef-463b-b691-1def5dafbed3 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:00.667022 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-829c0a31-42ef-463b-b691-1def5dafbed3 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1554 microversion: 2.1 time: 0.168891 May 13 13:24:00.668556 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 72/141] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:00 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:01.466647 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-3efae9a2-30cd-4e7d-a810-134fc696f0d9 req-ddff53ee-be0c-4f95-afdd-77f13b0b6d38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c9aa48-48db-4f84-9968-22cc353389ff", "name": "network-vif-deleted", "tag": "106f6edc-9afc-4bbf-9485-7d73427f23d2"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:24:01.478231 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-3efae9a2-30cd-4e7d-a810-134fc696f0d9 req-ddff53ee-be0c-4f95-afdd-77f13b0b6d38 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:01.478661 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-3efae9a2-30cd-4e7d-a810-134fc696f0d9 req-ddff53ee-be0c-4f95-afdd-77f13b0b6d38 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:01.489841 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-3efae9a2-30cd-4e7d-a810-134fc696f0d9 req-ddff53ee-be0c-4f95-afdd-77f13b0b6d38 service nova] Creating event network-vif-deleted:106f6edc-9afc-4bbf-9485-7d73427f23d2 for instance 20c9aa48-48db-4f84-9968-22cc353389ff on hv-cinder-84163 May 13 13:24:01.494872 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-3efae9a2-30cd-4e7d-a810-134fc696f0d9 req-ddff53ee-be0c-4f95-afdd-77f13b0b6d38 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032245 May 13 13:24:01.495545 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 70/142] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:24:01.555558 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-9240db08-bf84-4e82-b851-d0e9d4e5de7c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:01.555558 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-9240db08-bf84-4e82-b851-d0e9d4e5de7c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:01.558452 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9240db08-bf84-4e82-b851-d0e9d4e5de7c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:01.559187 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9240db08-bf84-4e82-b851-d0e9d4e5de7c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:01.560136 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9240db08-bf84-4e82-b851-d0e9d4e5de7c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:01.560799 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9240db08-bf84-4e82-b851-d0e9d4e5de7c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:01.686324 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ee41fe98-718b-41c1-b211-00474b10713a tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:01.687336 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ee41fe98-718b-41c1-b211-00474b10713a tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:01.707170 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ee41fe98-718b-41c1-b211-00474b10713a tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:01.707659 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ee41fe98-718b-41c1-b211-00474b10713a tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:01.708434 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ee41fe98-718b-41c1-b211-00474b10713a tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:01.710184 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ee41fe98-718b-41c1-b211-00474b10713a tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:01.750171 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-9240db08-bf84-4e82-b851-d0e9d4e5de7c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:01.759344 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-9240db08-bf84-4e82-b851-d0e9d4e5de7c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.222234 May 13 13:24:01.760726 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 73/143] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:01 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:01.780880 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ee41fe98-718b-41c1-b211-00474b10713a tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:01.789554 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ee41fe98-718b-41c1-b211-00474b10713a tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1346 microversion: 2.1 time: 0.108518 May 13 13:24:01.790224 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 71/144] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:01 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1346 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:03.005974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-291151c4-0594-4191-8f8a-1493ed2ca8f1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:03.005974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-291151c4-0594-4191-8f8a-1493ed2ca8f1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:03.005974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-291151c4-0594-4191-8f8a-1493ed2ca8f1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:03.005974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-291151c4-0594-4191-8f8a-1493ed2ca8f1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:03.007280 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-291151c4-0594-4191-8f8a-1493ed2ca8f1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:03.007280 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-291151c4-0594-4191-8f8a-1493ed2ca8f1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:03.007452 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8e0b1e52-92b4-4b3f-adad-39a97c2c6f20 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:03.007452 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8e0b1e52-92b4-4b3f-adad-39a97c2c6f20 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:03.007452 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8e0b1e52-92b4-4b3f-adad-39a97c2c6f20 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:03.007452 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8e0b1e52-92b4-4b3f-adad-39a97c2c6f20 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:03.008081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8e0b1e52-92b4-4b3f-adad-39a97c2c6f20 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:03.008081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8e0b1e52-92b4-4b3f-adad-39a97c2c6f20 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:03.008081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8e0b1e52-92b4-4b3f-adad-39a97c2c6f20 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:03.008081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8e0b1e52-92b4-4b3f-adad-39a97c2c6f20 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:03.008449 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-8e0b1e52-92b4-4b3f-adad-39a97c2c6f20 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lazy-loading 'fault' on Instance uuid 20c9aa48-48db-4f84-9968-22cc353389ff {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:24:03.008449 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8e0b1e52-92b4-4b3f-adad-39a97c2c6f20 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3e6aabf02c94a0d98fc04f75977fe9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d039bf33554bddb212aeb247b4645e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:03.008449 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8e0b1e52-92b4-4b3f-adad-39a97c2c6f20 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 200 len: 1351 microversion: 2.1 time: 0.119793 May 13 13:24:03.008449 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 72/145] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:02 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 1351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:24:03.008753 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-291151c4-0594-4191-8f8a-1493ed2ca8f1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:03.008753 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-291151c4-0594-4191-8f8a-1493ed2ca8f1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.191656 May 13 13:24:03.008753 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 74/146] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:02 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:04.014832 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d1ac0e2e-3adf-465e-ad9f-0ad40f21535b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:04.015784 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d1ac0e2e-3adf-465e-ad9f-0ad40f21535b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:04.022798 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d1ac0e2e-3adf-465e-ad9f-0ad40f21535b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:04.023243 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d1ac0e2e-3adf-465e-ad9f-0ad40f21535b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:04.023620 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-20f1b0ab-a9c2-4d62-8b54-8933d52c965a tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:04.024394 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-20f1b0ab-a9c2-4d62-8b54-8933d52c965a tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:04.025538 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d1ac0e2e-3adf-465e-ad9f-0ad40f21535b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:04.026137 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d1ac0e2e-3adf-465e-ad9f-0ad40f21535b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:04.031762 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-20f1b0ab-a9c2-4d62-8b54-8933d52c965a tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:04.032138 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-20f1b0ab-a9c2-4d62-8b54-8933d52c965a tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:04.032906 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-20f1b0ab-a9c2-4d62-8b54-8933d52c965a tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:04.033670 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-20f1b0ab-a9c2-4d62-8b54-8933d52c965a tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:04.051278 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-20f1b0ab-a9c2-4d62-8b54-8933d52c965a tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] HTTP exception thrown: Instance 20c9aa48-48db-4f84-9968-22cc353389ff could not be found. May 13 13:24:04.056596 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-20f1b0ab-a9c2-4d62-8b54-8933d52c965a tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Request method failure captured: May 13 13:24:04.056596 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff HTTP/1.1 May 13 13:24:04.056596 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept: application/json May 13 13:24:04.056596 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity May 13 13:24:04.056596 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Connection: close May 13 13:24:04.056596 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Length: 0 May 13 13:24:04.056596 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Type: application/json May 13 13:24:04.056596 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Host: 10.222.0.13 May 13 13:24:04.056596 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None May 13 13:24:04.056596 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 May 13 13:24:04.056596 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiflu0Ta0TuiDmhOF6O0xLUCWsJLcOhHc0sR4f1jhc_eBiShV6gs818H9CVcrEr951pNKZN7IDla5gHP0fEzdbll9tnzau8eUOFsVp38tlcAvdvYi0TdWC1Ts6XGqks1lVF7RILPZrStuxEYfvh3Nw3bcUgcoHPlPdowvjjCl_MFJ_iQQ May 13 13:24:04.056596 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Id: None May 13 13:24:04.056596 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Name: None May 13 13:24:04.056596 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed May 13 13:24:04.056596 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True May 13 13:24:04.056596 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default May 13 13:24:04.056596 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default May 13 13:24:04.056596 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Id: 53d039bf33554bddb212aeb247b4645e May 13 13:24:04.056596 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-DeleteServersTestJSON-1671539859 May 13 13:24:04.056596 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Role: member,reader May 13 13:24:04.056596 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Roles: member,reader May 13 13:24:04.058058 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_53d039bf33554bddb212aeb247b4645e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/53d039bf33554bddb212aeb247b4645e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/53d039bf33554bddb212aeb247b4645e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/53d039bf33554bddb212aeb247b4645e"}]}] May 13 13:24:04.058058 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-DeleteServersTestJSON-1671539859 May 13 13:24:04.058058 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 53d039bf33554bddb212aeb247b4645e May 13 13:24:04.058058 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-DeleteServersTestJSON-1671539859 May 13 13:24:04.058058 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User: tempest-DeleteServersTestJSON-1671539859-project May 13 13:24:04.058058 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default May 13 13:24:04.058058 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default May 13 13:24:04.058058 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Id: f3e6aabf02c94a0d98fc04f75977fe9c May 13 13:24:04.058058 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-DeleteServersTestJSON-1671539859-project May 13 13:24:04.058058 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: method: > May 13 13:24:04.058058 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: exception: Instance 20c9aa48-48db-4f84-9968-22cc353389ff could not be found. May 13 13:24:04.058058 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: action_args: {'id': '20c9aa48-48db-4f84-9968-22cc353389ff'} May 13 13:24:04.058982 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:24:04.058982 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:24:04.058982 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:24:04.058982 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:24:04.058982 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:24:04.058982 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:24:04.058982 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:24:04.058982 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:24:04.058982 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:24:04.058982 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:24:04.058982 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20c9aa48-48db-4f84-9968-22cc353389ff could not be found. May 13 13:24:04.058982 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:24:04.058982 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:24:04.058982 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:24:04.058982 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:24:04.058982 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:24:04.058982 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:24:04.058982 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:24:04.058982 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:24:04.058982 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:24:04.060638 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:24:04.060638 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:24:04.060638 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:24:04.060638 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:24:04.060638 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:24:04.060638 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:24:04.060638 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:24:04.060638 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20c9aa48-48db-4f84-9968-22cc353389ff could not be found. May 13 13:24:04.060638 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:24:04.060638 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:24:04.060638 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:24:04.060638 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:24:04.060638 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:24:04.060638 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:24:04.060638 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:24:04.060638 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:24:04.060638 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20c9aa48-48db-4f84-9968-22cc353389ff could not be found. May 13 13:24:04.060638 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:24:04.063042 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-20f1b0ab-a9c2-4d62-8b54-8933d52c965a tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Returning 404 to user: Instance 20c9aa48-48db-4f84-9968-22cc353389ff could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:24:04.067256 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-20f1b0ab-a9c2-4d62-8b54-8933d52c965a tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 404 len: 111 microversion: 2.1 time: 0.047964 May 13 13:24:04.068882 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 73/147] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:04 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 13:24:04.184587 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d1ac0e2e-3adf-465e-ad9f-0ad40f21535b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:04.197784 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d1ac0e2e-3adf-465e-ad9f-0ad40f21535b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.187256 May 13 13:24:04.204758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 75/148] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:04 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:04.820379 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2f81f18c-6a59-4362-9734-79f09e28cf41 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:04.825196 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2f81f18c-6a59-4362-9734-79f09e28cf41 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:04.837146 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2f81f18c-6a59-4362-9734-79f09e28cf41 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:04.837146 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2f81f18c-6a59-4362-9734-79f09e28cf41 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:04.837146 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2f81f18c-6a59-4362-9734-79f09e28cf41 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:04.837146 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2f81f18c-6a59-4362-9734-79f09e28cf41 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:04.849817 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-2f81f18c-6a59-4362-9734-79f09e28cf41 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] HTTP exception thrown: Instance 20c9aa48-48db-4f84-9968-22cc353389ff could not be found. May 13 13:24:04.852155 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2f81f18c-6a59-4362-9734-79f09e28cf41 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Request method failure captured: May 13 13:24:04.852155 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff/os-volume_attachments HTTP/1.1 May 13 13:24:04.852155 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept: application/json May 13 13:24:04.852155 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity May 13 13:24:04.852155 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Connection: close May 13 13:24:04.852155 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Length: 0 May 13 13:24:04.852155 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Type: application/json May 13 13:24:04.852155 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Host: 10.222.0.13 May 13 13:24:04.852155 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None May 13 13:24:04.852155 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 May 13 13:24:04.852155 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiflu0Ta0TuiDmhOF6O0xLUCWsJLcOhHc0sR4f1jhc_eBiShV6gs818H9CVcrEr951pNKZN7IDla5gHP0fEzdbll9tnzau8eUOFsVp38tlcAvdvYi0TdWC1Ts6XGqks1lVF7RILPZrStuxEYfvh3Nw3bcUgcoHPlPdowvjjCl_MFJ_iQQ May 13 13:24:04.852155 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Id: None May 13 13:24:04.852155 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Name: None May 13 13:24:04.852155 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed May 13 13:24:04.852155 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True May 13 13:24:04.852155 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default May 13 13:24:04.852155 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default May 13 13:24:04.852155 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Id: 53d039bf33554bddb212aeb247b4645e May 13 13:24:04.852155 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-DeleteServersTestJSON-1671539859 May 13 13:24:04.852155 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Role: member,reader May 13 13:24:04.852155 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Roles: member,reader May 13 13:24:04.853238 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_53d039bf33554bddb212aeb247b4645e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/53d039bf33554bddb212aeb247b4645e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/53d039bf33554bddb212aeb247b4645e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/53d039bf33554bddb212aeb247b4645e"}]}] May 13 13:24:04.853238 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-DeleteServersTestJSON-1671539859 May 13 13:24:04.853238 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 53d039bf33554bddb212aeb247b4645e May 13 13:24:04.853238 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-DeleteServersTestJSON-1671539859 May 13 13:24:04.853238 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User: tempest-DeleteServersTestJSON-1671539859-project May 13 13:24:04.853238 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default May 13 13:24:04.853238 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default May 13 13:24:04.853238 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Id: f3e6aabf02c94a0d98fc04f75977fe9c May 13 13:24:04.853238 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-DeleteServersTestJSON-1671539859-project May 13 13:24:04.853238 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: method: > May 13 13:24:04.853238 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: exception: Instance 20c9aa48-48db-4f84-9968-22cc353389ff could not be found. May 13 13:24:04.853238 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: action_args: {'server_id': '20c9aa48-48db-4f84-9968-22cc353389ff'} May 13 13:24:04.854786 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:24:04.854786 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:24:04.854786 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:24:04.854786 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:24:04.854786 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:24:04.854786 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:24:04.854786 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:24:04.854786 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:24:04.854786 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:24:04.854786 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:24:04.854786 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20c9aa48-48db-4f84-9968-22cc353389ff could not be found. May 13 13:24:04.854786 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:24:04.854786 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:24:04.854786 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:24:04.854786 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:24:04.854786 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:24:04.854786 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:24:04.854786 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:24:04.854786 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:24:04.854786 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:24:04.856112 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:24:04.856112 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 13 13:24:04.856112 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:24:04.856112 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 13 13:24:04.856112 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:24:04.856112 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 13 13:24:04.856112 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 13 13:24:04.856112 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:24:04.856112 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:24:04.856112 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20c9aa48-48db-4f84-9968-22cc353389ff could not be found. May 13 13:24:04.856112 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:24:04.856112 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:24:04.856112 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:24:04.856112 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:24:04.856112 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:24:04.856112 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:24:04.856112 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:24:04.856112 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:24:04.856112 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20c9aa48-48db-4f84-9968-22cc353389ff could not be found. May 13 13:24:04.856112 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:24:04.857267 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2f81f18c-6a59-4362-9734-79f09e28cf41 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Returning 404 to user: Instance 20c9aa48-48db-4f84-9968-22cc353389ff could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:24:04.857267 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2f81f18c-6a59-4362-9734-79f09e28cf41 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041252 May 13 13:24:04.857267 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 74/149] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 13 13:24:04 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:24:05.215160 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-082e3116-decd-4476-8e04-32f50b59859b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:05.215926 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-082e3116-decd-4476-8e04-32f50b59859b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:05.222882 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-082e3116-decd-4476-8e04-32f50b59859b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:05.223326 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-082e3116-decd-4476-8e04-32f50b59859b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:05.226918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-082e3116-decd-4476-8e04-32f50b59859b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:05.226918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-082e3116-decd-4476-8e04-32f50b59859b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:05.374795 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-082e3116-decd-4476-8e04-32f50b59859b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:05.380021 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-082e3116-decd-4476-8e04-32f50b59859b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.168888 May 13 13:24:05.381187 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 76/150] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:05 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:05.915998 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d086e3cc-b6c5-46f3-b02c-cf4c064a6adf tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1717146578", "imageRef": "ece294e8-5415-4d6a-a0d3-a14539c51c0a", "flavorRef": "452", "networks": [{"uuid": "7c2089ae-3254-4393-9e50-1eb3fedb8e31"}]}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:24:05.968995 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.network.neutron [None req-d086e3cc-b6c5-46f3-b02c-cf4c064a6adf tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] validate_networks() for [('7c2089ae-3254-4393-9e50-1eb3fedb8e31', None, None, None, None, None)] {{(pid=117720) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:24:06.233737 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ec2ac17b-8a98-47ec-8b69-bd8c8e885642 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:06.234327 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ec2ac17b-8a98-47ec-8b69-bd8c8e885642 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:06.240493 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ec2ac17b-8a98-47ec-8b69-bd8c8e885642 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:06.240963 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ec2ac17b-8a98-47ec-8b69-bd8c8e885642 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:06.241719 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ec2ac17b-8a98-47ec-8b69-bd8c8e885642 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:06.242164 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ec2ac17b-8a98-47ec-8b69-bd8c8e885642 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:06.256718 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-ec2ac17b-8a98-47ec-8b69-bd8c8e885642 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] HTTP exception thrown: Instance 20c9aa48-48db-4f84-9968-22cc353389ff could not be found. May 13 13:24:06.261793 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ec2ac17b-8a98-47ec-8b69-bd8c8e885642 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Request method failure captured: May 13 13:24:06.261793 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: DELETE /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff HTTP/1.1 May 13 13:24:06.261793 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:24:06.261793 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:24:06.261793 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:24:06.261793 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:24:06.261793 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:24:06.261793 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:24:06.261793 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:24:06.261793 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:24:06.261793 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiflu0Ta0TuiDmhOF6O0xLUCWsJLcOhHc0sR4f1jhc_eBiShV6gs818H9CVcrEr951pNKZN7IDla5gHP0fEzdbll9tnzau8eUOFsVp38tlcAvdvYi0TdWC1Ts6XGqks1lVF7RILPZrStuxEYfvh3Nw3bcUgcoHPlPdowvjjCl_MFJ_iQQ May 13 13:24:06.261793 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:24:06.261793 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:24:06.261793 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:24:06.261793 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:24:06.261793 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:24:06.261793 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:24:06.261793 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: 53d039bf33554bddb212aeb247b4645e May 13 13:24:06.261793 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-DeleteServersTestJSON-1671539859 May 13 13:24:06.261793 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:24:06.261793 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:24:06.263265 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_53d039bf33554bddb212aeb247b4645e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/53d039bf33554bddb212aeb247b4645e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/53d039bf33554bddb212aeb247b4645e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/53d039bf33554bddb212aeb247b4645e"}]}] May 13 13:24:06.263265 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-DeleteServersTestJSON-1671539859 May 13 13:24:06.263265 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 53d039bf33554bddb212aeb247b4645e May 13 13:24:06.263265 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-DeleteServersTestJSON-1671539859 May 13 13:24:06.263265 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-DeleteServersTestJSON-1671539859-project May 13 13:24:06.263265 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:24:06.263265 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:24:06.263265 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: f3e6aabf02c94a0d98fc04f75977fe9c May 13 13:24:06.263265 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-DeleteServersTestJSON-1671539859-project May 13 13:24:06.263265 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: > May 13 13:24:06.263265 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Instance 20c9aa48-48db-4f84-9968-22cc353389ff could not be found. May 13 13:24:06.263265 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': '20c9aa48-48db-4f84-9968-22cc353389ff'} May 13 13:24:06.264133 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:24:06.264133 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:24:06.264133 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:24:06.264133 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:24:06.264133 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:24:06.264133 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:24:06.264133 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:24:06.264133 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:24:06.264133 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:24:06.264133 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:24:06.264133 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20c9aa48-48db-4f84-9968-22cc353389ff could not be found. May 13 13:24:06.264133 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:24:06.264133 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:24:06.264133 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:24:06.264133 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:24:06.264133 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:24:06.264133 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:24:06.264133 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:24:06.264133 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:24:06.264133 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:24:06.265664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:24:06.265664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:24:06.265664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:24:06.265664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:24:06.265664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:24:06.265664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:24:06.265664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:24:06.265664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:24:06.265664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:24:06.265664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20c9aa48-48db-4f84-9968-22cc353389ff could not be found. May 13 13:24:06.265664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:24:06.265664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:24:06.265664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:24:06.265664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:24:06.265664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:24:06.265664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:24:06.265664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:24:06.265664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:24:06.265664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20c9aa48-48db-4f84-9968-22cc353389ff could not be found. May 13 13:24:06.265664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:24:06.268641 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ec2ac17b-8a98-47ec-8b69-bd8c8e885642 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Returning 404 to user: Instance 20c9aa48-48db-4f84-9968-22cc353389ff could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:24:06.269793 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ec2ac17b-8a98-47ec-8b69-bd8c8e885642 tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "DELETE /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 404 len: 111 microversion: 2.1 time: 0.040744 May 13 13:24:06.270787 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 77/151] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:24:06 2022] DELETE /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 13:24:06.279096 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8f47d910-8f47-45f5-acf1-11f5199c5afb tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:06.280620 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8f47d910-8f47-45f5-acf1-11f5199c5afb tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] [instance: 20c9aa48-48db-4f84-9968-22cc353389ff] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:06.286699 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8f47d910-8f47-45f5-acf1-11f5199c5afb tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:06.287279 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8f47d910-8f47-45f5-acf1-11f5199c5afb tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:06.288523 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8f47d910-8f47-45f5-acf1-11f5199c5afb tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:06.288959 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8f47d910-8f47-45f5-acf1-11f5199c5afb tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:06.304637 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-8f47d910-8f47-45f5-acf1-11f5199c5afb tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] HTTP exception thrown: Instance 20c9aa48-48db-4f84-9968-22cc353389ff could not be found. May 13 13:24:06.306250 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8f47d910-8f47-45f5-acf1-11f5199c5afb tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Request method failure captured: May 13 13:24:06.306250 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff HTTP/1.1 May 13 13:24:06.306250 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:24:06.306250 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:24:06.306250 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:24:06.306250 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:24:06.306250 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:24:06.306250 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:24:06.306250 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:24:06.306250 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:24:06.306250 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiflu0Ta0TuiDmhOF6O0xLUCWsJLcOhHc0sR4f1jhc_eBiShV6gs818H9CVcrEr951pNKZN7IDla5gHP0fEzdbll9tnzau8eUOFsVp38tlcAvdvYi0TdWC1Ts6XGqks1lVF7RILPZrStuxEYfvh3Nw3bcUgcoHPlPdowvjjCl_MFJ_iQQ May 13 13:24:06.306250 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:24:06.306250 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:24:06.306250 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:24:06.306250 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:24:06.306250 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:24:06.306250 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:24:06.306250 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: 53d039bf33554bddb212aeb247b4645e May 13 13:24:06.306250 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-DeleteServersTestJSON-1671539859 May 13 13:24:06.306250 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:24:06.306250 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:24:06.307517 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_53d039bf33554bddb212aeb247b4645e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/53d039bf33554bddb212aeb247b4645e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/53d039bf33554bddb212aeb247b4645e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/53d039bf33554bddb212aeb247b4645e"}]}] May 13 13:24:06.307517 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-DeleteServersTestJSON-1671539859 May 13 13:24:06.307517 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 53d039bf33554bddb212aeb247b4645e May 13 13:24:06.307517 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-DeleteServersTestJSON-1671539859 May 13 13:24:06.307517 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-DeleteServersTestJSON-1671539859-project May 13 13:24:06.307517 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:24:06.307517 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:24:06.307517 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: f3e6aabf02c94a0d98fc04f75977fe9c May 13 13:24:06.307517 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-DeleteServersTestJSON-1671539859-project May 13 13:24:06.307517 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: > May 13 13:24:06.307517 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Instance 20c9aa48-48db-4f84-9968-22cc353389ff could not be found. May 13 13:24:06.307517 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': '20c9aa48-48db-4f84-9968-22cc353389ff'} May 13 13:24:06.308163 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:24:06.308163 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:24:06.308163 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:24:06.308163 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:24:06.308163 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:24:06.308163 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:24:06.308163 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:24:06.308163 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:24:06.308163 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:24:06.308163 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:24:06.308163 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20c9aa48-48db-4f84-9968-22cc353389ff could not be found. May 13 13:24:06.308163 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:24:06.308163 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:24:06.308163 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:24:06.308163 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:24:06.308163 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:24:06.308163 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:24:06.308163 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:24:06.308163 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:24:06.308163 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:24:06.309209 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:24:06.309209 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:24:06.309209 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:24:06.309209 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:24:06.309209 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:24:06.309209 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:24:06.309209 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:24:06.309209 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20c9aa48-48db-4f84-9968-22cc353389ff could not be found. May 13 13:24:06.309209 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:24:06.309209 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:24:06.309209 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:24:06.309209 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:24:06.309209 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:24:06.309209 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:24:06.309209 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:24:06.309209 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:24:06.309209 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20c9aa48-48db-4f84-9968-22cc353389ff could not be found. May 13 13:24:06.309209 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:24:06.310175 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8f47d910-8f47-45f5-acf1-11f5199c5afb tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] Returning 404 to user: Instance 20c9aa48-48db-4f84-9968-22cc353389ff could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:24:06.310175 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8f47d910-8f47-45f5-acf1-11f5199c5afb tempest-DeleteServersTestJSON-1671539859 tempest-DeleteServersTestJSON-1671539859-project] 10.222.0.13 "GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff" status: 404 len: 111 microversion: 2.1 time: 0.032589 May 13 13:24:06.311997 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 78/152] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:06 2022] GET /compute/v2.1/servers/20c9aa48-48db-4f84-9968-22cc353389ff => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:24:06.399806 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-35b94b04-2b77-4027-ac30-721d4eee3b4d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:06.401257 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-35b94b04-2b77-4027-ac30-721d4eee3b4d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:06.413728 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-35b94b04-2b77-4027-ac30-721d4eee3b4d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:06.415839 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-35b94b04-2b77-4027-ac30-721d4eee3b4d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:06.416728 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-35b94b04-2b77-4027-ac30-721d4eee3b4d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:06.417489 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-35b94b04-2b77-4027-ac30-721d4eee3b4d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:06.624081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-d086e3cc-b6c5-46f3-b02c-cf4c064a6adf tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Flavor limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:24:06.624504 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-d086e3cc-b6c5-46f3-b02c-cf4c064a6adf tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Image limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:24:06.625169 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-d086e3cc-b6c5-46f3-b02c-cf4c064a6adf tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Flavor pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:24:06.625573 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-d086e3cc-b6c5-46f3-b02c-cf4c064a6adf tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Image pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:24:06.625975 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-d086e3cc-b6c5-46f3-b02c-cf4c064a6adf tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:24:06.639730 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d086e3cc-b6c5-46f3-b02c-cf4c064a6adf tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:06.640254 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d086e3cc-b6c5-46f3-b02c-cf4c064a6adf tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:06.641715 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d086e3cc-b6c5-46f3-b02c-cf4c064a6adf tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:06.642231 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d086e3cc-b6c5-46f3-b02c-cf4c064a6adf tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:06.667558 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-35b94b04-2b77-4027-ac30-721d4eee3b4d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:06.673419 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-d086e3cc-b6c5-46f3-b02c-cf4c064a6adf tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Getting quotas for project a06d65a7a7d244d8b8f97aab0ef63684. Resources: {'cores', 'instances', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:24:06.679885 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-d086e3cc-b6c5-46f3-b02c-cf4c064a6adf tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Getting quotas for user 18b40229043f46fea15181b950a892fd and project a06d65a7a7d244d8b8f97aab0ef63684. Resources: {'cores', 'instances', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:24:06.685063 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-35b94b04-2b77-4027-ac30-721d4eee3b4d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.289121 May 13 13:24:06.687367 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 79/153] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:06 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:06.720896 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d086e3cc-b6c5-46f3-b02c-cf4c064a6adf tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Going to run 1 instances... {{(pid=117720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:24:06.720896 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d086e3cc-b6c5-46f3-b02c-cf4c064a6adf tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 2184863b-7be8-470d-9369-12dd0297b6df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ece294e8-5415-4d6a-a0d3-a14539c51c0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:24:06.871662 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d086e3cc-b6c5-46f3-b02c-cf4c064a6adf tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.959381 May 13 13:24:06.877748 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 75/154] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 13 13:24:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:24:06.884218 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-38f14f24-817f-4582-86c7-e193712f0357 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:06.885941 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-38f14f24-817f-4582-86c7-e193712f0357 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 2184863b-7be8-470d-9369-12dd0297b6df] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:06.976971 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-38f14f24-817f-4582-86c7-e193712f0357 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:06.983720 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-38f14f24-817f-4582-86c7-e193712f0357 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df" status: 200 len: 1219 microversion: 2.1 time: 0.104747 May 13 13:24:07.007375 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 80/155] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:06 2022] GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:24:07.703349 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e8074d98-1d77-47ae-b3e5-15f6932434b7 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:07.703989 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e8074d98-1d77-47ae-b3e5-15f6932434b7 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:07.710488 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e8074d98-1d77-47ae-b3e5-15f6932434b7 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:07.710931 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e8074d98-1d77-47ae-b3e5-15f6932434b7 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:07.711696 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e8074d98-1d77-47ae-b3e5-15f6932434b7 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:07.712186 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e8074d98-1d77-47ae-b3e5-15f6932434b7 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:07.853477 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e8074d98-1d77-47ae-b3e5-15f6932434b7 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:07.864472 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e8074d98-1d77-47ae-b3e5-15f6932434b7 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.164965 May 13 13:24:07.865232 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 76/156] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:07 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:08.000534 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ec467a3e-428e-492b-bd4c-b20289d4543a tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:08.001890 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ec467a3e-428e-492b-bd4c-b20289d4543a tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 2184863b-7be8-470d-9369-12dd0297b6df] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:08.062838 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ec467a3e-428e-492b-bd4c-b20289d4543a tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:08.070715 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ec467a3e-428e-492b-bd4c-b20289d4543a tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df" status: 200 len: 1219 microversion: 2.1 time: 0.074227 May 13 13:24:08.071281 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 81/157] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:07 2022] GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:08.891076 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-be4547b6-6954-4f96-8754-db28c74291d7 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:08.891678 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-be4547b6-6954-4f96-8754-db28c74291d7 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:08.899482 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-be4547b6-6954-4f96-8754-db28c74291d7 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:08.900010 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-be4547b6-6954-4f96-8754-db28c74291d7 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:08.903002 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-be4547b6-6954-4f96-8754-db28c74291d7 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:08.903002 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-be4547b6-6954-4f96-8754-db28c74291d7 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:09.047840 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-be4547b6-6954-4f96-8754-db28c74291d7 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:09.055938 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-be4547b6-6954-4f96-8754-db28c74291d7 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.168887 May 13 13:24:09.062005 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 77/158] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:08 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:09.090726 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6544b1de-2baf-42c6-93fc-e27bbf828e53 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:09.092442 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6544b1de-2baf-42c6-93fc-e27bbf828e53 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 2184863b-7be8-470d-9369-12dd0297b6df] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:09.100302 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6544b1de-2baf-42c6-93fc-e27bbf828e53 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:09.100663 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6544b1de-2baf-42c6-93fc-e27bbf828e53 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:09.101568 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6544b1de-2baf-42c6-93fc-e27bbf828e53 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:09.102096 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6544b1de-2baf-42c6-93fc-e27bbf828e53 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:09.188049 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6544b1de-2baf-42c6-93fc-e27bbf828e53 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:09.196092 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6544b1de-2baf-42c6-93fc-e27bbf828e53 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df" status: 200 len: 1223 microversion: 2.1 time: 0.110346 May 13 13:24:09.196686 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 82/159] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:09 2022] GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df => generated 1223 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:10.074469 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3de71907-1b16-423b-84bc-93226cbee63d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:10.075301 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3de71907-1b16-423b-84bc-93226cbee63d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:10.081527 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3de71907-1b16-423b-84bc-93226cbee63d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:10.081981 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3de71907-1b16-423b-84bc-93226cbee63d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:10.082798 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3de71907-1b16-423b-84bc-93226cbee63d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:10.083233 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3de71907-1b16-423b-84bc-93226cbee63d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:10.220826 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ba8d3015-6664-4051-883b-d9ae074e265f tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:10.222742 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ba8d3015-6664-4051-883b-d9ae074e265f tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 2184863b-7be8-470d-9369-12dd0297b6df] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:10.235211 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ba8d3015-6664-4051-883b-d9ae074e265f tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:10.235816 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ba8d3015-6664-4051-883b-d9ae074e265f tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:10.236872 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ba8d3015-6664-4051-883b-d9ae074e265f tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:10.237385 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ba8d3015-6664-4051-883b-d9ae074e265f tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:10.242462 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3de71907-1b16-423b-84bc-93226cbee63d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:10.251825 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3de71907-1b16-423b-84bc-93226cbee63d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.181106 May 13 13:24:10.252548 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 78/160] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:10 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:10.324886 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ba8d3015-6664-4051-883b-d9ae074e265f tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:10.336392 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ba8d3015-6664-4051-883b-d9ae074e265f tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df" status: 200 len: 1215 microversion: 2.1 time: 0.122167 May 13 13:24:10.338191 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 83/161] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:10 2022] GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df => generated 1215 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:24:11.270742 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-05920847-f33f-4f65-8623-5bcd4eaf5085 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:11.271964 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-05920847-f33f-4f65-8623-5bcd4eaf5085 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:11.280883 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-05920847-f33f-4f65-8623-5bcd4eaf5085 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:11.283880 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-05920847-f33f-4f65-8623-5bcd4eaf5085 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:11.286106 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-05920847-f33f-4f65-8623-5bcd4eaf5085 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:11.287299 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-05920847-f33f-4f65-8623-5bcd4eaf5085 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:11.365721 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-40f4c8ef-57a1-4188-b285-9462c5bfe812 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:11.367081 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-40f4c8ef-57a1-4188-b285-9462c5bfe812 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 2184863b-7be8-470d-9369-12dd0297b6df] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:11.376657 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-40f4c8ef-57a1-4188-b285-9462c5bfe812 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:11.377101 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-40f4c8ef-57a1-4188-b285-9462c5bfe812 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:11.380206 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-40f4c8ef-57a1-4188-b285-9462c5bfe812 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:11.380709 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-40f4c8ef-57a1-4188-b285-9462c5bfe812 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:11.514472 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-40f4c8ef-57a1-4188-b285-9462c5bfe812 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:11.525754 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-40f4c8ef-57a1-4188-b285-9462c5bfe812 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df" status: 200 len: 1289 microversion: 2.1 time: 0.164914 May 13 13:24:11.537393 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 84/162] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:11 2022] GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df => generated 1289 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:11.607661 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-05920847-f33f-4f65-8623-5bcd4eaf5085 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:11.626400 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-05920847-f33f-4f65-8623-5bcd4eaf5085 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.359428 May 13 13:24:11.635578 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 79/163] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:11 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:12.543249 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-bfd831dc-48e1-4868-a6c2-e322e1e3e8b3 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:12.543855 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-bfd831dc-48e1-4868-a6c2-e322e1e3e8b3 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 2184863b-7be8-470d-9369-12dd0297b6df] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:12.559651 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bfd831dc-48e1-4868-a6c2-e322e1e3e8b3 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:12.563842 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bfd831dc-48e1-4868-a6c2-e322e1e3e8b3 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:12.565175 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bfd831dc-48e1-4868-a6c2-e322e1e3e8b3 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:12.566424 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bfd831dc-48e1-4868-a6c2-e322e1e3e8b3 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:12.660445 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0715d285-8ad3-43d8-a922-ca08c1323acc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:12.661880 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0715d285-8ad3-43d8-a922-ca08c1323acc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:12.681725 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0715d285-8ad3-43d8-a922-ca08c1323acc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:12.687158 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0715d285-8ad3-43d8-a922-ca08c1323acc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:12.700656 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0715d285-8ad3-43d8-a922-ca08c1323acc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:12.701321 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0715d285-8ad3-43d8-a922-ca08c1323acc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:12.918040 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-bfd831dc-48e1-4868-a6c2-e322e1e3e8b3 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:12.926174 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-bfd831dc-48e1-4868-a6c2-e322e1e3e8b3 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df" status: 200 len: 1319 microversion: 2.1 time: 0.387031 May 13 13:24:12.926763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 85/164] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:12 2022] GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df => generated 1319 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:13.113515 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0715d285-8ad3-43d8-a922-ca08c1323acc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:13.121302 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0715d285-8ad3-43d8-a922-ca08c1323acc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.472725 May 13 13:24:13.132085 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 80/165] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:12 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:13.631520 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-6e4dde38-4d03-4925-8739-79f342a56817 req-a71c82e2-68a0-4f7f-a201-2502f1bdc772 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2184863b-7be8-470d-9369-12dd0297b6df", "tag": "f582d3bf-ec6f-40d5-9a9f-73169c7b67cb"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:24:13.637935 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-6e4dde38-4d03-4925-8739-79f342a56817 req-a71c82e2-68a0-4f7f-a201-2502f1bdc772 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:13.638593 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-6e4dde38-4d03-4925-8739-79f342a56817 req-a71c82e2-68a0-4f7f-a201-2502f1bdc772 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:13.655510 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-6e4dde38-4d03-4925-8739-79f342a56817 req-a71c82e2-68a0-4f7f-a201-2502f1bdc772 service nova] Creating event network-changed:f582d3bf-ec6f-40d5-9a9f-73169c7b67cb for instance 2184863b-7be8-470d-9369-12dd0297b6df on hv-cinder-84163 May 13 13:24:13.659723 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-6e4dde38-4d03-4925-8739-79f342a56817 req-a71c82e2-68a0-4f7f-a201-2502f1bdc772 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035346 May 13 13:24:13.661137 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 86/166] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:24:13.943065 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3493be99-c72f-4cab-876d-fd7547db0c29 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:13.943787 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3493be99-c72f-4cab-876d-fd7547db0c29 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 2184863b-7be8-470d-9369-12dd0297b6df] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:13.956314 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3493be99-c72f-4cab-876d-fd7547db0c29 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:13.956772 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3493be99-c72f-4cab-876d-fd7547db0c29 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:13.957560 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3493be99-c72f-4cab-876d-fd7547db0c29 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:13.957991 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3493be99-c72f-4cab-876d-fd7547db0c29 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:14.143988 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a662f732-379c-42c5-8591-f2b4b50faaf4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:14.150479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a662f732-379c-42c5-8591-f2b4b50faaf4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:14.158502 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a662f732-379c-42c5-8591-f2b4b50faaf4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:14.159415 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a662f732-379c-42c5-8591-f2b4b50faaf4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:14.166136 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a662f732-379c-42c5-8591-f2b4b50faaf4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:14.166915 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a662f732-379c-42c5-8591-f2b4b50faaf4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:14.367093 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3493be99-c72f-4cab-876d-fd7547db0c29 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:14.376684 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3493be99-c72f-4cab-876d-fd7547db0c29 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df" status: 200 len: 1319 microversion: 2.1 time: 0.437357 May 13 13:24:14.377278 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 81/167] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:13 2022] GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df => generated 1319 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:14.522871 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a662f732-379c-42c5-8591-f2b4b50faaf4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:14.536481 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a662f732-379c-42c5-8591-f2b4b50faaf4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.399263 May 13 13:24:14.548008 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 87/168] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:14 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:15.393754 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-70600564-f002-44f2-9c34-e6fe5aa9bc5d tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:15.394404 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-70600564-f002-44f2-9c34-e6fe5aa9bc5d tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 2184863b-7be8-470d-9369-12dd0297b6df] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:15.400607 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-70600564-f002-44f2-9c34-e6fe5aa9bc5d tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:15.401048 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-70600564-f002-44f2-9c34-e6fe5aa9bc5d tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:15.401806 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-70600564-f002-44f2-9c34-e6fe5aa9bc5d tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:15.402263 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-70600564-f002-44f2-9c34-e6fe5aa9bc5d tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:15.554731 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4d7fabdc-4acb-4a74-b8f6-df46af4eb0b8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:15.555946 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4d7fabdc-4acb-4a74-b8f6-df46af4eb0b8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:15.576701 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4d7fabdc-4acb-4a74-b8f6-df46af4eb0b8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:15.577154 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4d7fabdc-4acb-4a74-b8f6-df46af4eb0b8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:15.577953 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4d7fabdc-4acb-4a74-b8f6-df46af4eb0b8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:15.578436 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4d7fabdc-4acb-4a74-b8f6-df46af4eb0b8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:15.646741 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-70600564-f002-44f2-9c34-e6fe5aa9bc5d tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:15.656017 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-70600564-f002-44f2-9c34-e6fe5aa9bc5d tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df" status: 200 len: 1319 microversion: 2.1 time: 0.266078 May 13 13:24:15.659199 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 82/169] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:15 2022] GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:15.842569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4d7fabdc-4acb-4a74-b8f6-df46af4eb0b8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:15.851330 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4d7fabdc-4acb-4a74-b8f6-df46af4eb0b8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.300529 May 13 13:24:15.851910 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 88/170] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:15 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:16.676808 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a3876f2d-f0e4-4636-8297-e6d7f56c4406 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:16.677437 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a3876f2d-f0e4-4636-8297-e6d7f56c4406 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 2184863b-7be8-470d-9369-12dd0297b6df] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:16.683703 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a3876f2d-f0e4-4636-8297-e6d7f56c4406 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:16.684372 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a3876f2d-f0e4-4636-8297-e6d7f56c4406 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:16.685302 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a3876f2d-f0e4-4636-8297-e6d7f56c4406 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:16.686021 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a3876f2d-f0e4-4636-8297-e6d7f56c4406 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:16.868789 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-feaf6fd9-754c-4dcc-8602-54b2b343e1ff tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:16.870008 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-feaf6fd9-754c-4dcc-8602-54b2b343e1ff tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:16.877544 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-feaf6fd9-754c-4dcc-8602-54b2b343e1ff tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:16.878343 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-feaf6fd9-754c-4dcc-8602-54b2b343e1ff tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:16.879196 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-feaf6fd9-754c-4dcc-8602-54b2b343e1ff tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:16.879634 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-feaf6fd9-754c-4dcc-8602-54b2b343e1ff tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:17.233867 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a3876f2d-f0e4-4636-8297-e6d7f56c4406 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:17.247389 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a3876f2d-f0e4-4636-8297-e6d7f56c4406 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df" status: 200 len: 1319 microversion: 2.1 time: 0.574217 May 13 13:24:17.249046 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 83/171] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:16 2022] GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df => generated 1319 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:17.315569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-feaf6fd9-754c-4dcc-8602-54b2b343e1ff tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:17.323366 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-feaf6fd9-754c-4dcc-8602-54b2b343e1ff tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.458390 May 13 13:24:17.324034 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 89/172] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:16 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:17.637914 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b87d307e-f331-4f8b-8337-d05004c89fb2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Action: 'create', calling method: .version_select at 0x7fb084413670>, body: {"keypair": {"name": "tempest-keypair-1161005691", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDBbuwE0xEM+KARgyjvDFhmqKYcSzluZzx6Op4vnecZ3cHApnSg/L7I2rs6lP7be7/Y1HR7EAMP+Nm40oNQdyrRoMD3T6WfcH/yxgFnHnpR3q9gg+v87kAJA7uhPzxOzg=="}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:24:17.670774 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-b87d307e-f331-4f8b-8337-d05004c89fb2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Getting quotas for project 2c900748e271404bb3cb11fb2308e784. Resources: {'key_pairs'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:24:17.676568 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-b87d307e-f331-4f8b-8337-d05004c89fb2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Getting quotas for user e25df7c837584b19afe274f6edfb8efd and project 2c900748e271404bb3cb11fb2308e784. Resources: {'key_pairs'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:24:17.784049 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b87d307e-f331-4f8b-8337-d05004c89fb2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.310093 May 13 13:24:17.785246 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 84/173] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 13 13:24:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:24:18.268262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-716dedd1-ea9f-4b07-bb37-2a085d687ef7 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:18.269846 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-716dedd1-ea9f-4b07-bb37-2a085d687ef7 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 2184863b-7be8-470d-9369-12dd0297b6df] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:18.283475 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-716dedd1-ea9f-4b07-bb37-2a085d687ef7 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:18.288969 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-716dedd1-ea9f-4b07-bb37-2a085d687ef7 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:18.298779 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-716dedd1-ea9f-4b07-bb37-2a085d687ef7 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:18.299419 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-716dedd1-ea9f-4b07-bb37-2a085d687ef7 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:18.342498 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-bf14c1ea-0531-4154-a94c-8bdb474d48b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:18.343119 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-bf14c1ea-0531-4154-a94c-8bdb474d48b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:18.352004 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bf14c1ea-0531-4154-a94c-8bdb474d48b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:18.352710 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bf14c1ea-0531-4154-a94c-8bdb474d48b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:18.353762 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bf14c1ea-0531-4154-a94c-8bdb474d48b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:18.354384 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bf14c1ea-0531-4154-a94c-8bdb474d48b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:18.577229 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-716dedd1-ea9f-4b07-bb37-2a085d687ef7 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:18.585236 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-716dedd1-ea9f-4b07-bb37-2a085d687ef7 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df" status: 200 len: 1319 microversion: 2.1 time: 0.322983 May 13 13:24:18.586005 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 90/174] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:18 2022] GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df => generated 1319 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:18.612240 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-bf14c1ea-0531-4154-a94c-8bdb474d48b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:18.621635 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-bf14c1ea-0531-4154-a94c-8bdb474d48b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.283898 May 13 13:24:18.622237 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 85/175] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:18 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:19.282301 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-265d52cf-62f7-4d3e-b8ff-356358dda92a req-efa90c46-5e5e-4d28-9e73-26d5976e0610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2184863b-7be8-470d-9369-12dd0297b6df", "name": "network-vif-plugged", "status": "completed", "tag": "f582d3bf-ec6f-40d5-9a9f-73169c7b67cb"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:24:19.302061 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-265d52cf-62f7-4d3e-b8ff-356358dda92a req-efa90c46-5e5e-4d28-9e73-26d5976e0610 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:19.310365 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-265d52cf-62f7-4d3e-b8ff-356358dda92a req-efa90c46-5e5e-4d28-9e73-26d5976e0610 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:19.332520 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-265d52cf-62f7-4d3e-b8ff-356358dda92a req-efa90c46-5e5e-4d28-9e73-26d5976e0610 service nova] Creating event network-vif-plugged:f582d3bf-ec6f-40d5-9a9f-73169c7b67cb for instance 2184863b-7be8-470d-9369-12dd0297b6df on hv-cinder-84163 May 13 13:24:19.340987 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-265d52cf-62f7-4d3e-b8ff-356358dda92a req-efa90c46-5e5e-4d28-9e73-26d5976e0610 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062607 May 13 13:24:19.341625 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 91/176] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:24:19.603947 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-24932d79-b70c-4a07-878f-6bb7f29de0e6 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:19.605171 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-24932d79-b70c-4a07-878f-6bb7f29de0e6 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 2184863b-7be8-470d-9369-12dd0297b6df] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:19.614009 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-24932d79-b70c-4a07-878f-6bb7f29de0e6 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:19.614407 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-24932d79-b70c-4a07-878f-6bb7f29de0e6 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:19.615197 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-24932d79-b70c-4a07-878f-6bb7f29de0e6 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:19.615787 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-24932d79-b70c-4a07-878f-6bb7f29de0e6 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:19.640754 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cdc80002-b2f9-4bcf-99f3-58446391a088 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:19.641705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-cdc80002-b2f9-4bcf-99f3-58446391a088 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:19.663525 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cdc80002-b2f9-4bcf-99f3-58446391a088 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:19.664324 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cdc80002-b2f9-4bcf-99f3-58446391a088 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:19.665636 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cdc80002-b2f9-4bcf-99f3-58446391a088 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:19.666830 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cdc80002-b2f9-4bcf-99f3-58446391a088 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:20.098806 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-cdc80002-b2f9-4bcf-99f3-58446391a088 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:20.102617 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-24932d79-b70c-4a07-878f-6bb7f29de0e6 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:20.108230 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-cdc80002-b2f9-4bcf-99f3-58446391a088 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.473084 May 13 13:24:20.112140 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-24932d79-b70c-4a07-878f-6bb7f29de0e6 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df" status: 200 len: 1319 microversion: 2.1 time: 0.512676 May 13 13:24:20.112969 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 86/177] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:19 2022] GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df => generated 1319 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:24:20.119116 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 92/178] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:19 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:24:21.053454 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b0678a6d-a6a3-430d-88c7-65a65e0c6902 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2096830074", "imageRef": "ece294e8-5415-4d6a-a0d3-a14539c51c0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc71e07c-eb5e-4e51-82e1-4253b2766878"}], "security_groups": [{"name": "tempest-securitygroup--125375347"}], "key_name": "tempest-keypair-1161005691", "user_data": "}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:24:21.127012 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f624867b-9288-4917-8c6b-2a6784e4342b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:21.128234 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f624867b-9288-4917-8c6b-2a6784e4342b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:21.143879 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f624867b-9288-4917-8c6b-2a6784e4342b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:21.144385 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f624867b-9288-4917-8c6b-2a6784e4342b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:21.145261 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f624867b-9288-4917-8c6b-2a6784e4342b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:21.145680 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f624867b-9288-4917-8c6b-2a6784e4342b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:21.305980 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.network.neutron [None req-b0678a6d-a6a3-430d-88c7-65a65e0c6902 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] validate_networks() for [('fc71e07c-eb5e-4e51-82e1-4253b2766878', None, None, None, None, None)] {{(pid=117720) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:24:21.411108 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f624867b-9288-4917-8c6b-2a6784e4342b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:21.427287 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f624867b-9288-4917-8c6b-2a6784e4342b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.304704 May 13 13:24:21.428274 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 93/179] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:21 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:24:21.433908 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-775a17ca-56f5-44d2-9c54-85f1c5b1b9ef tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:21.434921 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-775a17ca-56f5-44d2-9c54-85f1c5b1b9ef tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 2184863b-7be8-470d-9369-12dd0297b6df] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:21.442918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-775a17ca-56f5-44d2-9c54-85f1c5b1b9ef tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:21.443427 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-775a17ca-56f5-44d2-9c54-85f1c5b1b9ef tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:21.444205 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-775a17ca-56f5-44d2-9c54-85f1c5b1b9ef tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:21.444693 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-775a17ca-56f5-44d2-9c54-85f1c5b1b9ef tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:21.752390 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-775a17ca-56f5-44d2-9c54-85f1c5b1b9ef tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:21.768084 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-775a17ca-56f5-44d2-9c54-85f1c5b1b9ef tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df" status: 200 len: 1505 microversion: 2.1 time: 0.334319 May 13 13:24:21.769281 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 94/180] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:21 2022] GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:21.961180 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-b0678a6d-a6a3-430d-88c7-65a65e0c6902 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Flavor limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:24:21.961617 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-b0678a6d-a6a3-430d-88c7-65a65e0c6902 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Image limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:24:21.962278 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-b0678a6d-a6a3-430d-88c7-65a65e0c6902 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Flavor pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:24:21.962688 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-b0678a6d-a6a3-430d-88c7-65a65e0c6902 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Image pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:24:21.963097 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-b0678a6d-a6a3-430d-88c7-65a65e0c6902 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:24:21.974005 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b0678a6d-a6a3-430d-88c7-65a65e0c6902 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:21.974400 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b0678a6d-a6a3-430d-88c7-65a65e0c6902 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:21.975267 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b0678a6d-a6a3-430d-88c7-65a65e0c6902 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:21.975965 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b0678a6d-a6a3-430d-88c7-65a65e0c6902 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:22.001584 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-b0678a6d-a6a3-430d-88c7-65a65e0c6902 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Getting quotas for project 2c900748e271404bb3cb11fb2308e784. Resources: {'cores', 'instances', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:24:22.005446 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-b0678a6d-a6a3-430d-88c7-65a65e0c6902 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Getting quotas for user e25df7c837584b19afe274f6edfb8efd and project 2c900748e271404bb3cb11fb2308e784. Resources: {'cores', 'instances', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:24:22.019877 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b0678a6d-a6a3-430d-88c7-65a65e0c6902 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Going to run 1 instances... {{(pid=117720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:24:22.022010 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b0678a6d-a6a3-430d-88c7-65a65e0c6902 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ece294e8-5415-4d6a-a0d3-a14539c51c0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:24:22.217836 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b0678a6d-a6a3-430d-88c7-65a65e0c6902 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.168629 May 13 13:24:22.223916 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 87/181] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 13 13:24:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 1175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:24:22.229047 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-216a9adf-fe75-4830-91ad-52c8b03346e6 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:22.229871 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-216a9adf-fe75-4830-91ad-52c8b03346e6 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:22.289530 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-216a9adf-fe75-4830-91ad-52c8b03346e6 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:22.299882 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-216a9adf-fe75-4830-91ad-52c8b03346e6 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af" status: 200 len: 1242 microversion: 2.1 time: 0.071912 May 13 13:24:22.299882 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 95/182] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:22 2022] GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:22.450800 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-68e70bb0-1c40-4fb9-9c81-dede2ea52dd9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:22.454431 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-68e70bb0-1c40-4fb9-9c81-dede2ea52dd9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:22.458496 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-68e70bb0-1c40-4fb9-9c81-dede2ea52dd9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:22.458946 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-68e70bb0-1c40-4fb9-9c81-dede2ea52dd9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:22.460197 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-68e70bb0-1c40-4fb9-9c81-dede2ea52dd9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:22.460624 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-68e70bb0-1c40-4fb9-9c81-dede2ea52dd9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:22.693365 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-68e70bb0-1c40-4fb9-9c81-dede2ea52dd9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:22.703754 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-68e70bb0-1c40-4fb9-9c81-dede2ea52dd9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.256624 May 13 13:24:22.704346 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 88/183] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:22 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:23.314582 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e926f2ea-affa-431d-b1f4-ff94a1547e6a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:23.315188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e926f2ea-affa-431d-b1f4-ff94a1547e6a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:23.544588 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e926f2ea-affa-431d-b1f4-ff94a1547e6a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:23.551763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e926f2ea-affa-431d-b1f4-ff94a1547e6a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af" status: 200 len: 1242 microversion: 2.1 time: 0.241383 May 13 13:24:23.552480 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 96/184] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:23 2022] GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af => generated 1242 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:24:23.721449 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-21b7444f-7b4d-49e5-a27d-13101b8c876b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:23.722236 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-21b7444f-7b4d-49e5-a27d-13101b8c876b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:23.728820 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-21b7444f-7b4d-49e5-a27d-13101b8c876b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:23.729380 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-21b7444f-7b4d-49e5-a27d-13101b8c876b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:23.730277 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-21b7444f-7b4d-49e5-a27d-13101b8c876b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:23.730934 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-21b7444f-7b4d-49e5-a27d-13101b8c876b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:23.923678 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-21b7444f-7b4d-49e5-a27d-13101b8c876b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:23.931419 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-21b7444f-7b4d-49e5-a27d-13101b8c876b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.214216 May 13 13:24:23.933804 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 89/185] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:23 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:24.570401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8146595f-267c-4ea9-9d27-bff7c9f9cc5d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:24.571027 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8146595f-267c-4ea9-9d27-bff7c9f9cc5d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:24.579103 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8146595f-267c-4ea9-9d27-bff7c9f9cc5d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:24.579575 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8146595f-267c-4ea9-9d27-bff7c9f9cc5d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:24.580354 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8146595f-267c-4ea9-9d27-bff7c9f9cc5d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:24.580783 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8146595f-267c-4ea9-9d27-bff7c9f9cc5d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:24.653759 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8146595f-267c-4ea9-9d27-bff7c9f9cc5d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:24.661469 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8146595f-267c-4ea9-9d27-bff7c9f9cc5d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af" status: 200 len: 1294 microversion: 2.1 time: 0.096139 May 13 13:24:24.662131 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 97/186] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:24 2022] GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af => generated 1294 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:24.952026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0300162c-75ce-4336-99f0-44c7a190fd60 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:24.953318 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0300162c-75ce-4336-99f0-44c7a190fd60 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:24.963130 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0300162c-75ce-4336-99f0-44c7a190fd60 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:24.963574 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0300162c-75ce-4336-99f0-44c7a190fd60 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:24.964344 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0300162c-75ce-4336-99f0-44c7a190fd60 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:24.964774 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0300162c-75ce-4336-99f0-44c7a190fd60 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:25.136795 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0300162c-75ce-4336-99f0-44c7a190fd60 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:25.146250 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0300162c-75ce-4336-99f0-44c7a190fd60 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.199009 May 13 13:24:25.146825 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 90/187] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:24 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:25.680737 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-90d57243-6e43-4cc4-8035-507cdc23772c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:25.681270 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-90d57243-6e43-4cc4-8035-507cdc23772c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:25.687947 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-90d57243-6e43-4cc4-8035-507cdc23772c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:25.688409 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-90d57243-6e43-4cc4-8035-507cdc23772c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:25.689159 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-90d57243-6e43-4cc4-8035-507cdc23772c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:25.689586 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-90d57243-6e43-4cc4-8035-507cdc23772c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:25.779570 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-90d57243-6e43-4cc4-8035-507cdc23772c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:25.790786 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-90d57243-6e43-4cc4-8035-507cdc23772c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af" status: 200 len: 1312 microversion: 2.1 time: 0.112288 May 13 13:24:25.790786 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 98/188] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:25 2022] GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af => generated 1312 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:26.163489 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-55164a18-08db-4220-a6a9-068cb2947858 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:26.164108 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-55164a18-08db-4220-a6a9-068cb2947858 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:26.171096 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-55164a18-08db-4220-a6a9-068cb2947858 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:26.171525 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-55164a18-08db-4220-a6a9-068cb2947858 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:26.172302 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-55164a18-08db-4220-a6a9-068cb2947858 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:26.172732 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-55164a18-08db-4220-a6a9-068cb2947858 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:26.316936 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-55164a18-08db-4220-a6a9-068cb2947858 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:26.324572 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-55164a18-08db-4220-a6a9-068cb2947858 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.164919 May 13 13:24:26.335683 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 91/189] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:26 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:26.816068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5f4a5b7f-ab73-48b6-a886-dc175a0dfca0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:26.816705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5f4a5b7f-ab73-48b6-a886-dc175a0dfca0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:26.826153 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5f4a5b7f-ab73-48b6-a886-dc175a0dfca0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:26.826638 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5f4a5b7f-ab73-48b6-a886-dc175a0dfca0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:26.827982 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5f4a5b7f-ab73-48b6-a886-dc175a0dfca0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:26.827982 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5f4a5b7f-ab73-48b6-a886-dc175a0dfca0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:26.896897 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5f4a5b7f-ab73-48b6-a886-dc175a0dfca0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:26.904984 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5f4a5b7f-ab73-48b6-a886-dc175a0dfca0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af" status: 200 len: 1300 microversion: 2.1 time: 0.095057 May 13 13:24:26.912364 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 99/190] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:26 2022] GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af => generated 1300 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:27.343673 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0ec5a5b8-91fb-4856-bf9c-baa93a4260da tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:27.345292 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0ec5a5b8-91fb-4856-bf9c-baa93a4260da tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:27.351824 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0ec5a5b8-91fb-4856-bf9c-baa93a4260da tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:27.352487 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0ec5a5b8-91fb-4856-bf9c-baa93a4260da tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:27.353275 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0ec5a5b8-91fb-4856-bf9c-baa93a4260da tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:27.353739 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0ec5a5b8-91fb-4856-bf9c-baa93a4260da tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:27.503658 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0ec5a5b8-91fb-4856-bf9c-baa93a4260da tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:27.512307 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0ec5a5b8-91fb-4856-bf9c-baa93a4260da tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1523 microversion: 2.1 time: 0.173054 May 13 13:24:27.522154 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 92/191] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:27 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:27.924021 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f34fbc85-e319-453a-821f-bc4741528ced tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:27.924748 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f34fbc85-e319-453a-821f-bc4741528ced tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:27.933206 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f34fbc85-e319-453a-821f-bc4741528ced tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:27.933832 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f34fbc85-e319-453a-821f-bc4741528ced tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:27.934512 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f34fbc85-e319-453a-821f-bc4741528ced tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:27.935014 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f34fbc85-e319-453a-821f-bc4741528ced tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:28.108643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f34fbc85-e319-453a-821f-bc4741528ced tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:28.124475 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f34fbc85-e319-453a-821f-bc4741528ced tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af" status: 200 len: 1367 microversion: 2.1 time: 0.201307 May 13 13:24:28.124475 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 100/192] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:27 2022] GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:28.531548 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c203424b-2c34-42d4-a663-7de1ff393825 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:28.536206 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c203424b-2c34-42d4-a663-7de1ff393825 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:28.554229 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c203424b-2c34-42d4-a663-7de1ff393825 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:28.559388 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c203424b-2c34-42d4-a663-7de1ff393825 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:28.559388 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c203424b-2c34-42d4-a663-7de1ff393825 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:28.559388 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c203424b-2c34-42d4-a663-7de1ff393825 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:28.693888 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-e5958dec-1e1b-4c6c-a85b-f2e7ae29b38c req-9f28b259-0941-446c-a11c-6906e024d079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b86888c8-bdd2-468d-a602-67b4f27fb7af", "tag": "5f9e6c55-7597-460f-acea-9d4b111093cb"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:24:28.705448 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-e5958dec-1e1b-4c6c-a85b-f2e7ae29b38c req-9f28b259-0941-446c-a11c-6906e024d079 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:28.706313 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-e5958dec-1e1b-4c6c-a85b-f2e7ae29b38c req-9f28b259-0941-446c-a11c-6906e024d079 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:28.717575 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c203424b-2c34-42d4-a663-7de1ff393825 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:28.726133 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c203424b-2c34-42d4-a663-7de1ff393825 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1503 microversion: 2.1 time: 0.200356 May 13 13:24:28.726806 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 93/193] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:28 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1503 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:28.735592 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-e5958dec-1e1b-4c6c-a85b-f2e7ae29b38c req-9f28b259-0941-446c-a11c-6906e024d079 service nova] Creating event network-changed:5f9e6c55-7597-460f-acea-9d4b111093cb for instance b86888c8-bdd2-468d-a602-67b4f27fb7af on hv-cinder-84163 May 13 13:24:28.742960 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-923ee59b-f574-4caa-ba59-ba6ffcc848ae tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:28.743876 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-923ee59b-f574-4caa-ba59-ba6ffcc848ae tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:28.745974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-e5958dec-1e1b-4c6c-a85b-f2e7ae29b38c req-9f28b259-0941-446c-a11c-6906e024d079 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055449 May 13 13:24:28.747023 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 101/194] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:24:28.752014 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-923ee59b-f574-4caa-ba59-ba6ffcc848ae tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:28.752014 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-923ee59b-f574-4caa-ba59-ba6ffcc848ae tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:28.752487 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-923ee59b-f574-4caa-ba59-ba6ffcc848ae tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:28.753089 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-923ee59b-f574-4caa-ba59-ba6ffcc848ae tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:28.923864 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-923ee59b-f574-4caa-ba59-ba6ffcc848ae tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:28.933192 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-923ee59b-f574-4caa-ba59-ba6ffcc848ae tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1515 microversion: 2.1 time: 0.194298 May 13 13:24:28.934916 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 94/195] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:28 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:24:29.140563 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a7a2dc34-ad7a-4788-9669-dccdaeab705e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:29.145293 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a7a2dc34-ad7a-4788-9669-dccdaeab705e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:29.148535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a7a2dc34-ad7a-4788-9669-dccdaeab705e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:29.149160 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a7a2dc34-ad7a-4788-9669-dccdaeab705e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:29.150099 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a7a2dc34-ad7a-4788-9669-dccdaeab705e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:29.151286 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a7a2dc34-ad7a-4788-9669-dccdaeab705e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:29.323481 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a7a2dc34-ad7a-4788-9669-dccdaeab705e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:29.333788 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a7a2dc34-ad7a-4788-9669-dccdaeab705e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af" status: 200 len: 1367 microversion: 2.1 time: 0.197629 May 13 13:24:29.338926 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 102/196] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:29 2022] GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:30.358487 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9321bd04-7633-46ed-9471-a7aea8e4ca26 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:30.359676 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9321bd04-7633-46ed-9471-a7aea8e4ca26 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:30.370161 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9321bd04-7633-46ed-9471-a7aea8e4ca26 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:30.370642 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9321bd04-7633-46ed-9471-a7aea8e4ca26 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:30.371600 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9321bd04-7633-46ed-9471-a7aea8e4ca26 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:30.372317 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9321bd04-7633-46ed-9471-a7aea8e4ca26 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:30.524797 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9321bd04-7633-46ed-9471-a7aea8e4ca26 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:30.534117 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9321bd04-7633-46ed-9471-a7aea8e4ca26 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af" status: 200 len: 1367 microversion: 2.1 time: 0.180298 May 13 13:24:30.535111 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 95/197] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:30 2022] GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:30.758622 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-62c0d7c4-1e90-4e1e-98da-32bd88c337a4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:24:30.759983 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-62c0d7c4-1e90-4e1e-98da-32bd88c337a4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:30.769261 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-62c0d7c4-1e90-4e1e-98da-32bd88c337a4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:30.769701 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-62c0d7c4-1e90-4e1e-98da-32bd88c337a4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:30.770492 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-62c0d7c4-1e90-4e1e-98da-32bd88c337a4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:30.770920 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-62c0d7c4-1e90-4e1e-98da-32bd88c337a4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:30.795243 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-62c0d7c4-1e90-4e1e-98da-32bd88c337a4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lazy-loading 'flavor' on Instance uuid 75885842-8f4b-43a8-aa30-0da326e4f6e3 {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:24:31.115930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-62c0d7c4-1e90-4e1e-98da-32bd88c337a4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "POST /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3/action" status: 200 len: 32 microversion: 2.1 time: 0.361872 May 13 13:24:31.116536 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 103/198] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 13 13:24:30 2022] POST /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3/action => generated 32 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 13:24:31.127003 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9f7a3eb3-d48a-43be-8df1-29018ac63c40 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:31.127746 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9f7a3eb3-d48a-43be-8df1-29018ac63c40 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:31.133954 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9f7a3eb3-d48a-43be-8df1-29018ac63c40 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:31.134434 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9f7a3eb3-d48a-43be-8df1-29018ac63c40 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:31.135517 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9f7a3eb3-d48a-43be-8df1-29018ac63c40 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:31.136152 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9f7a3eb3-d48a-43be-8df1-29018ac63c40 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:31.303284 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9f7a3eb3-d48a-43be-8df1-29018ac63c40 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:31.313755 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9f7a3eb3-d48a-43be-8df1-29018ac63c40 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.191005 May 13 13:24:31.314384 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 96/199] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:31 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:31.552352 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cb1e70a4-cec8-46e0-aad4-427f1e7bf21e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:31.553038 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-cb1e70a4-cec8-46e0-aad4-427f1e7bf21e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:31.564044 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cb1e70a4-cec8-46e0-aad4-427f1e7bf21e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:31.564496 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cb1e70a4-cec8-46e0-aad4-427f1e7bf21e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:31.568056 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cb1e70a4-cec8-46e0-aad4-427f1e7bf21e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:31.568495 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cb1e70a4-cec8-46e0-aad4-427f1e7bf21e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:31.814144 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-cb1e70a4-cec8-46e0-aad4-427f1e7bf21e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:31.821909 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-cb1e70a4-cec8-46e0-aad4-427f1e7bf21e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af" status: 200 len: 1367 microversion: 2.1 time: 0.274189 May 13 13:24:31.822515 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 104/200] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:31 2022] GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:32.331476 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3d27c246-90d4-4c62-82b7-730b38023b41 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:32.332087 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3d27c246-90d4-4c62-82b7-730b38023b41 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:32.339786 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3d27c246-90d4-4c62-82b7-730b38023b41 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:32.343366 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3d27c246-90d4-4c62-82b7-730b38023b41 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:32.343366 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3d27c246-90d4-4c62-82b7-730b38023b41 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:32.343366 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3d27c246-90d4-4c62-82b7-730b38023b41 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:32.525964 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3d27c246-90d4-4c62-82b7-730b38023b41 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:32.541197 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3d27c246-90d4-4c62-82b7-730b38023b41 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.213804 May 13 13:24:32.542375 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 97/201] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:32 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:32.840310 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b0bb8925-0fcf-4628-adc4-e69327621f6c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:32.841000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b0bb8925-0fcf-4628-adc4-e69327621f6c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:32.849535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b0bb8925-0fcf-4628-adc4-e69327621f6c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:32.850461 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b0bb8925-0fcf-4628-adc4-e69327621f6c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:32.851694 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b0bb8925-0fcf-4628-adc4-e69327621f6c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:32.852684 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b0bb8925-0fcf-4628-adc4-e69327621f6c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:33.028539 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b0bb8925-0fcf-4628-adc4-e69327621f6c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:33.040811 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b0bb8925-0fcf-4628-adc4-e69327621f6c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af" status: 200 len: 1367 microversion: 2.1 time: 0.204301 May 13 13:24:33.052946 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 105/202] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:32 2022] GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:33.559766 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a1c44393-1600-47c7-8991-92ca595b0c19 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:33.561293 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a1c44393-1600-47c7-8991-92ca595b0c19 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:33.567476 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a1c44393-1600-47c7-8991-92ca595b0c19 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:33.567904 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a1c44393-1600-47c7-8991-92ca595b0c19 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:33.569261 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a1c44393-1600-47c7-8991-92ca595b0c19 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:33.570148 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a1c44393-1600-47c7-8991-92ca595b0c19 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:33.733844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a1c44393-1600-47c7-8991-92ca595b0c19 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:33.743405 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a1c44393-1600-47c7-8991-92ca595b0c19 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.187633 May 13 13:24:33.744543 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 98/203] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:33 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:34.059138 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8e06b4ff-7647-4880-a506-8802a9dc1a42 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:34.059810 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8e06b4ff-7647-4880-a506-8802a9dc1a42 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:34.066926 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8e06b4ff-7647-4880-a506-8802a9dc1a42 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:34.067361 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8e06b4ff-7647-4880-a506-8802a9dc1a42 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:34.068249 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8e06b4ff-7647-4880-a506-8802a9dc1a42 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:34.068683 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8e06b4ff-7647-4880-a506-8802a9dc1a42 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:34.246154 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8e06b4ff-7647-4880-a506-8802a9dc1a42 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:34.250172 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8e06b4ff-7647-4880-a506-8802a9dc1a42 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af" status: 200 len: 1367 microversion: 2.1 time: 0.194740 May 13 13:24:34.250950 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 106/204] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:34 2022] GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:34.761352 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-59dc0042-9894-4e59-81c3-5c96c167d132 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:34.761943 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-59dc0042-9894-4e59-81c3-5c96c167d132 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:34.769134 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-59dc0042-9894-4e59-81c3-5c96c167d132 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:34.769653 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-59dc0042-9894-4e59-81c3-5c96c167d132 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:34.770599 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-59dc0042-9894-4e59-81c3-5c96c167d132 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:34.771113 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-59dc0042-9894-4e59-81c3-5c96c167d132 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:34.901163 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-59dc0042-9894-4e59-81c3-5c96c167d132 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:34.909663 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-59dc0042-9894-4e59-81c3-5c96c167d132 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.152469 May 13 13:24:34.910263 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 99/205] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:34 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:35.171645 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-382365d0-6ae8-4691-b687-794c43e938eb req-322a83c8-8adf-4670-8bc6-5fb34bc4f878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86888c8-bdd2-468d-a602-67b4f27fb7af", "name": "network-vif-plugged", "status": "completed", "tag": "5f9e6c55-7597-460f-acea-9d4b111093cb"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:24:35.181458 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-382365d0-6ae8-4691-b687-794c43e938eb req-322a83c8-8adf-4670-8bc6-5fb34bc4f878 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:35.182438 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-382365d0-6ae8-4691-b687-794c43e938eb req-322a83c8-8adf-4670-8bc6-5fb34bc4f878 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:35.194909 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-382365d0-6ae8-4691-b687-794c43e938eb req-322a83c8-8adf-4670-8bc6-5fb34bc4f878 service nova] Creating event network-vif-plugged:5f9e6c55-7597-460f-acea-9d4b111093cb for instance b86888c8-bdd2-468d-a602-67b4f27fb7af on hv-cinder-84163 May 13 13:24:35.200521 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-382365d0-6ae8-4691-b687-794c43e938eb req-322a83c8-8adf-4670-8bc6-5fb34bc4f878 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033483 May 13 13:24:35.202974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 107/206] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:24:35.267467 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-fc2764f8-755d-4c5d-91af-d4ea5d8b1862 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:35.268532 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-fc2764f8-755d-4c5d-91af-d4ea5d8b1862 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:35.275746 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fc2764f8-755d-4c5d-91af-d4ea5d8b1862 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:35.276740 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fc2764f8-755d-4c5d-91af-d4ea5d8b1862 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:35.277825 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fc2764f8-755d-4c5d-91af-d4ea5d8b1862 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:35.278964 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fc2764f8-755d-4c5d-91af-d4ea5d8b1862 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:35.416217 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fc2764f8-755d-4c5d-91af-d4ea5d8b1862 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:35.429039 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-fc2764f8-755d-4c5d-91af-d4ea5d8b1862 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af" status: 200 len: 1367 microversion: 2.1 time: 0.165769 May 13 13:24:35.429619 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 100/207] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:35 2022] GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:35.926834 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4cf92d55-72f0-445b-a9a5-b6d4e47b4cc2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:35.927828 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4cf92d55-72f0-445b-a9a5-b6d4e47b4cc2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:35.943828 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4cf92d55-72f0-445b-a9a5-b6d4e47b4cc2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:35.943828 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4cf92d55-72f0-445b-a9a5-b6d4e47b4cc2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:35.943828 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4cf92d55-72f0-445b-a9a5-b6d4e47b4cc2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:35.943828 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4cf92d55-72f0-445b-a9a5-b6d4e47b4cc2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:36.292405 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4cf92d55-72f0-445b-a9a5-b6d4e47b4cc2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:36.301072 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4cf92d55-72f0-445b-a9a5-b6d4e47b4cc2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.378653 May 13 13:24:36.301641 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 108/208] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:35 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:36.446781 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-dd6a8fc4-328e-493e-89e5-87bf88427a66 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:36.458356 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-dd6a8fc4-328e-493e-89e5-87bf88427a66 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:36.458356 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dd6a8fc4-328e-493e-89e5-87bf88427a66 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:36.458356 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dd6a8fc4-328e-493e-89e5-87bf88427a66 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:36.458356 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dd6a8fc4-328e-493e-89e5-87bf88427a66 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:36.459084 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dd6a8fc4-328e-493e-89e5-87bf88427a66 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:36.590586 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dd6a8fc4-328e-493e-89e5-87bf88427a66 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:36.598464 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-dd6a8fc4-328e-493e-89e5-87bf88427a66 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af" status: 200 len: 1367 microversion: 2.1 time: 0.155440 May 13 13:24:36.599031 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 101/209] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:36 2022] GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:37.319075 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-83efeed1-63e9-4ffa-b6d9-93114ec0c692 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:37.319830 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-83efeed1-63e9-4ffa-b6d9-93114ec0c692 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:37.326872 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-83efeed1-63e9-4ffa-b6d9-93114ec0c692 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:37.327296 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-83efeed1-63e9-4ffa-b6d9-93114ec0c692 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:37.328187 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-83efeed1-63e9-4ffa-b6d9-93114ec0c692 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:37.328612 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-83efeed1-63e9-4ffa-b6d9-93114ec0c692 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:37.475478 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-83efeed1-63e9-4ffa-b6d9-93114ec0c692 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:37.488455 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-83efeed1-63e9-4ffa-b6d9-93114ec0c692 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.173271 May 13 13:24:37.489738 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 109/210] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:37 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:24:37.615660 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b01131e9-6189-43f7-b0ba-ebf37be5b3b6 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:37.616260 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b01131e9-6189-43f7-b0ba-ebf37be5b3b6 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:37.624256 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b01131e9-6189-43f7-b0ba-ebf37be5b3b6 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:37.624806 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b01131e9-6189-43f7-b0ba-ebf37be5b3b6 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:37.625888 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b01131e9-6189-43f7-b0ba-ebf37be5b3b6 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:37.626662 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b01131e9-6189-43f7-b0ba-ebf37be5b3b6 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:37.912266 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b01131e9-6189-43f7-b0ba-ebf37be5b3b6 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:37.920205 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b01131e9-6189-43f7-b0ba-ebf37be5b3b6 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af" status: 200 len: 1556 microversion: 2.1 time: 0.307829 May 13 13:24:37.920481 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 102/211] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:37 2022] GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af => generated 1556 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:37.938413 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cdb7f7b6-ab74-48f5-94cc-369763b6e8ca tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:37.938906 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-cdb7f7b6-ab74-48f5-94cc-369763b6e8ca tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:37.945203 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cdb7f7b6-ab74-48f5-94cc-369763b6e8ca tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:37.946333 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cdb7f7b6-ab74-48f5-94cc-369763b6e8ca tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:37.946473 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cdb7f7b6-ab74-48f5-94cc-369763b6e8ca tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:37.946922 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cdb7f7b6-ab74-48f5-94cc-369763b6e8ca tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:38.032719 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-cdb7f7b6-ab74-48f5-94cc-369763b6e8ca tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098770 May 13 13:24:38.033321 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 110/212] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 13 13:24:37 2022] GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:24:38.507793 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-92a0b72e-aa6e-41a6-acbb-5bee63977a32 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:38.509011 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-92a0b72e-aa6e-41a6-acbb-5bee63977a32 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:38.516486 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-92a0b72e-aa6e-41a6-acbb-5bee63977a32 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:38.516936 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-92a0b72e-aa6e-41a6-acbb-5bee63977a32 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:38.517724 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-92a0b72e-aa6e-41a6-acbb-5bee63977a32 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:38.518156 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-92a0b72e-aa6e-41a6-acbb-5bee63977a32 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:38.770860 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-9a6b6724-cd9d-4b71-8844-ff95e7b0dcb3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:38.771427 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-9a6b6724-cd9d-4b71-8844-ff95e7b0dcb3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:38.777367 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9a6b6724-cd9d-4b71-8844-ff95e7b0dcb3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:38.777814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9a6b6724-cd9d-4b71-8844-ff95e7b0dcb3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:38.785347 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9a6b6724-cd9d-4b71-8844-ff95e7b0dcb3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:38.785347 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9a6b6724-cd9d-4b71-8844-ff95e7b0dcb3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:38.805203 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-9a6b6724-cd9d-4b71-8844-ff95e7b0dcb3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86/ips" status: 200 len: 145 microversion: 2.1 time: 0.039066 May 13 13:24:38.805972 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 111/213] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 13 13:24:38 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:24:38.862662 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-92a0b72e-aa6e-41a6-acbb-5bee63977a32 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:38.871345 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-92a0b72e-aa6e-41a6-acbb-5bee63977a32 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.368603 May 13 13:24:38.872106 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 103/214] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:38 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:39.690400 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-b638d4fd-c85d-4e69-ad67-5a7b4658926d req-b74830ba-526b-4050-8574-2f04d1ece37e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b86888c8-bdd2-468d-a602-67b4f27fb7af", "tag": "5f9e6c55-7597-460f-acea-9d4b111093cb"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:24:39.698491 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-b638d4fd-c85d-4e69-ad67-5a7b4658926d req-b74830ba-526b-4050-8574-2f04d1ece37e service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:39.700208 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-b638d4fd-c85d-4e69-ad67-5a7b4658926d req-b74830ba-526b-4050-8574-2f04d1ece37e service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:39.711437 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-b638d4fd-c85d-4e69-ad67-5a7b4658926d req-b74830ba-526b-4050-8574-2f04d1ece37e service nova] Creating event network-changed:5f9e6c55-7597-460f-acea-9d4b111093cb for instance b86888c8-bdd2-468d-a602-67b4f27fb7af on hv-cinder-84163 May 13 13:24:39.716205 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-b638d4fd-c85d-4e69-ad67-5a7b4658926d req-b74830ba-526b-4050-8574-2f04d1ece37e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029493 May 13 13:24:39.718118 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 112/215] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:24:39.891894 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f099df50-8414-484f-b144-db2fce7f2c57 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:39.893110 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f099df50-8414-484f-b144-db2fce7f2c57 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:39.900588 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f099df50-8414-484f-b144-db2fce7f2c57 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:39.901600 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f099df50-8414-484f-b144-db2fce7f2c57 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:39.902609 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f099df50-8414-484f-b144-db2fce7f2c57 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:39.903253 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f099df50-8414-484f-b144-db2fce7f2c57 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:40.079696 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f099df50-8414-484f-b144-db2fce7f2c57 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:40.089867 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f099df50-8414-484f-b144-db2fce7f2c57 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.204428 May 13 13:24:40.090806 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 104/216] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:39 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:41.109933 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5717e31a-93a7-47c5-a2b3-8031d9186602 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:41.114064 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5717e31a-93a7-47c5-a2b3-8031d9186602 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:41.121964 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5717e31a-93a7-47c5-a2b3-8031d9186602 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:41.122619 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5717e31a-93a7-47c5-a2b3-8031d9186602 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:41.124110 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5717e31a-93a7-47c5-a2b3-8031d9186602 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:41.124528 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5717e31a-93a7-47c5-a2b3-8031d9186602 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:41.279354 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5717e31a-93a7-47c5-a2b3-8031d9186602 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:41.289387 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5717e31a-93a7-47c5-a2b3-8031d9186602 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.182636 May 13 13:24:41.289387 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 113/217] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:41 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:42.304984 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-44fda35f-9118-476b-8d8f-e89ad7cf006b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:42.305585 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-44fda35f-9118-476b-8d8f-e89ad7cf006b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:42.311935 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-44fda35f-9118-476b-8d8f-e89ad7cf006b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:42.312626 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-44fda35f-9118-476b-8d8f-e89ad7cf006b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:42.313875 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-44fda35f-9118-476b-8d8f-e89ad7cf006b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:42.314653 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-44fda35f-9118-476b-8d8f-e89ad7cf006b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:42.458815 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-44fda35f-9118-476b-8d8f-e89ad7cf006b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:42.475434 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-44fda35f-9118-476b-8d8f-e89ad7cf006b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.174264 May 13 13:24:42.476385 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 105/218] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:42 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:43.493152 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0d8adf41-574b-471b-a163-3ca6933757e8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:43.495365 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0d8adf41-574b-471b-a163-3ca6933757e8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:43.501964 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0d8adf41-574b-471b-a163-3ca6933757e8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:43.502443 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0d8adf41-574b-471b-a163-3ca6933757e8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:43.503222 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0d8adf41-574b-471b-a163-3ca6933757e8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:43.503655 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0d8adf41-574b-471b-a163-3ca6933757e8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:43.721461 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0d8adf41-574b-471b-a163-3ca6933757e8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:43.729831 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0d8adf41-574b-471b-a163-3ca6933757e8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.240263 May 13 13:24:43.730745 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 114/219] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:43 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:44.593357 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a2001541-0c35-4720-8878-e7d4ca2db060 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "522527c4-721a-4c9b-89da-79770b08cc9a", "device": "/dev/sdb"}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:24:44.595066 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a2001541-0c35-4720-8878-e7d4ca2db060 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 2184863b-7be8-470d-9369-12dd0297b6df] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:44.600841 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a2001541-0c35-4720-8878-e7d4ca2db060 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:44.601293 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a2001541-0c35-4720-8878-e7d4ca2db060 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:44.602043 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a2001541-0c35-4720-8878-e7d4ca2db060 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:44.602496 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a2001541-0c35-4720-8878-e7d4ca2db060 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:44.749927 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c397aa3f-518c-42f4-ba15-917f088603c4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:44.750926 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c397aa3f-518c-42f4-ba15-917f088603c4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:44.757032 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c397aa3f-518c-42f4-ba15-917f088603c4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:44.757553 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c397aa3f-518c-42f4-ba15-917f088603c4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:44.758437 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c397aa3f-518c-42f4-ba15-917f088603c4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:44.758955 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c397aa3f-518c-42f4-ba15-917f088603c4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:44.976228 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c397aa3f-518c-42f4-ba15-917f088603c4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:44.984463 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c397aa3f-518c-42f4-ba15-917f088603c4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.239062 May 13 13:24:44.987616 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 115/220] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:44 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:24:45.387331 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a2001541-0c35-4720-8878-e7d4ca2db060 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "POST /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.797734 May 13 13:24:45.388005 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 106/221] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 13 13:24:44 2022] POST /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df/os-volume_attachments => generated 194 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:24:46.002279 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-052daa42-c0c8-4c7d-87b8-d1b4fdbb1954 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:46.003026 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-052daa42-c0c8-4c7d-87b8-d1b4fdbb1954 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:46.009258 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-052daa42-c0c8-4c7d-87b8-d1b4fdbb1954 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:46.009698 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-052daa42-c0c8-4c7d-87b8-d1b4fdbb1954 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:46.010496 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-052daa42-c0c8-4c7d-87b8-d1b4fdbb1954 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:46.010932 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-052daa42-c0c8-4c7d-87b8-d1b4fdbb1954 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:46.184513 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d0494c7d-a7d3-42b3-89d7-c7f5ef1bdbf1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fcd97759-8cae-4d0a-aef5-3ffc92b21a8e"}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:24:46.186569 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d0494c7d-a7d3-42b3-89d7-c7f5ef1bdbf1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:46.194881 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d0494c7d-a7d3-42b3-89d7-c7f5ef1bdbf1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:46.195260 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d0494c7d-a7d3-42b3-89d7-c7f5ef1bdbf1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:46.196262 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d0494c7d-a7d3-42b3-89d7-c7f5ef1bdbf1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:46.196691 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d0494c7d-a7d3-42b3-89d7-c7f5ef1bdbf1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:46.207835 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-052daa42-c0c8-4c7d-87b8-d1b4fdbb1954 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:46.216086 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-052daa42-c0c8-4c7d-87b8-d1b4fdbb1954 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.217646 May 13 13:24:46.217337 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 116/222] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:45 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:47.233793 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-96212591-2337-416d-ab02-566f4e2911b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:47.234453 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-96212591-2337-416d-ab02-566f4e2911b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:47.239078 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d0494c7d-a7d3-42b3-89d7-c7f5ef1bdbf1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "POST /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.059299 May 13 13:24:47.240459 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 107/223] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 13 13:24:46 2022] POST /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86/os-volume_attachments => generated 194 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:24:47.241424 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-96212591-2337-416d-ab02-566f4e2911b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:47.241860 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-96212591-2337-416d-ab02-566f4e2911b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:47.242661 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-96212591-2337-416d-ab02-566f4e2911b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:47.243092 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-96212591-2337-416d-ab02-566f4e2911b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:47.414178 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-96212591-2337-416d-ab02-566f4e2911b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:47.422301 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-96212591-2337-416d-ab02-566f4e2911b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.193233 May 13 13:24:47.422892 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 117/224] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:47 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:24:48.441931 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a58a053b-2e83-4961-b114-e5e34226fd06 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:48.442988 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a58a053b-2e83-4961-b114-e5e34226fd06 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:48.454691 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a58a053b-2e83-4961-b114-e5e34226fd06 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:48.462947 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a58a053b-2e83-4961-b114-e5e34226fd06 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:48.467096 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a58a053b-2e83-4961-b114-e5e34226fd06 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:48.467096 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a58a053b-2e83-4961-b114-e5e34226fd06 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:48.614316 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a58a053b-2e83-4961-b114-e5e34226fd06 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:48.624591 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a58a053b-2e83-4961-b114-e5e34226fd06 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.187130 May 13 13:24:48.625289 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 108/225] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:48 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:49.641181 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a5e19a13-e65d-4a55-92b4-1e3ba9dab995 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:49.641911 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a5e19a13-e65d-4a55-92b4-1e3ba9dab995 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:49.649336 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a5e19a13-e65d-4a55-92b4-1e3ba9dab995 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:49.649788 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a5e19a13-e65d-4a55-92b4-1e3ba9dab995 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:49.650605 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a5e19a13-e65d-4a55-92b4-1e3ba9dab995 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:49.651168 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a5e19a13-e65d-4a55-92b4-1e3ba9dab995 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:49.815694 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a5e19a13-e65d-4a55-92b4-1e3ba9dab995 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:49.824125 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a5e19a13-e65d-4a55-92b4-1e3ba9dab995 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.186983 May 13 13:24:49.824724 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-19fca924-8138-4980-bcc3-60e5e2a7babd tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:49.825248 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-19fca924-8138-4980-bcc3-60e5e2a7babd tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:49.825957 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 118/226] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:49 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:49.831773 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-19fca924-8138-4980-bcc3-60e5e2a7babd tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:49.837186 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-19fca924-8138-4980-bcc3-60e5e2a7babd tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:49.837186 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-19fca924-8138-4980-bcc3-60e5e2a7babd tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:49.837186 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-19fca924-8138-4980-bcc3-60e5e2a7babd tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:49.859130 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-19fca924-8138-4980-bcc3-60e5e2a7babd tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6/ips" status: 200 len: 152 microversion: 2.20 time: 0.038839 May 13 13:24:49.859724 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 109/227] 10.222.0.13 () {60 vars in 1288 bytes} [Fri May 13 13:24:49 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 13:24:50.843100 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8c8abe9f-d747-43ba-a3aa-ff5cbb543362 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:50.843653 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8c8abe9f-d747-43ba-a3aa-ff5cbb543362 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:50.850001 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c8abe9f-d747-43ba-a3aa-ff5cbb543362 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:50.850480 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c8abe9f-d747-43ba-a3aa-ff5cbb543362 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:50.851240 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c8abe9f-d747-43ba-a3aa-ff5cbb543362 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:50.851672 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c8abe9f-d747-43ba-a3aa-ff5cbb543362 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:50.983509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8c8abe9f-d747-43ba-a3aa-ff5cbb543362 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:50.990883 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8c8abe9f-d747-43ba-a3aa-ff5cbb543362 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.151980 May 13 13:24:50.991449 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 119/228] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:50 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:52.007986 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0f9dfa89-3785-4f44-aaba-b9a178d8151d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:52.008586 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0f9dfa89-3785-4f44-aaba-b9a178d8151d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:52.015527 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0f9dfa89-3785-4f44-aaba-b9a178d8151d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:52.015968 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0f9dfa89-3785-4f44-aaba-b9a178d8151d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:52.016723 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0f9dfa89-3785-4f44-aaba-b9a178d8151d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:52.017149 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0f9dfa89-3785-4f44-aaba-b9a178d8151d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:52.141732 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0f9dfa89-3785-4f44-aaba-b9a178d8151d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:52.148958 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0f9dfa89-3785-4f44-aaba-b9a178d8151d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.144703 May 13 13:24:52.149519 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 110/229] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:52 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:53.170580 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-32ccad0c-8c48-46bb-a854-4ed09ddf5fbd tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:53.171562 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-32ccad0c-8c48-46bb-a854-4ed09ddf5fbd tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:53.179970 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-32ccad0c-8c48-46bb-a854-4ed09ddf5fbd tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:53.180417 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-32ccad0c-8c48-46bb-a854-4ed09ddf5fbd tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:53.181186 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-32ccad0c-8c48-46bb-a854-4ed09ddf5fbd tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:53.181618 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-32ccad0c-8c48-46bb-a854-4ed09ddf5fbd tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:53.327215 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-32ccad0c-8c48-46bb-a854-4ed09ddf5fbd tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:53.335801 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-32ccad0c-8c48-46bb-a854-4ed09ddf5fbd tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.172292 May 13 13:24:53.336391 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 120/230] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:53 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:54.250744 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9ab8b215-577f-4af3-869d-e1462a5302ae tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:24:54.258230 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9ab8b215-577f-4af3-869d-e1462a5302ae tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:54.258230 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9ab8b215-577f-4af3-869d-e1462a5302ae tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:54.258450 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9ab8b215-577f-4af3-869d-e1462a5302ae tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:54.259188 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9ab8b215-577f-4af3-869d-e1462a5302ae tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:54.259680 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9ab8b215-577f-4af3-869d-e1462a5302ae tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:54.284071 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-9ab8b215-577f-4af3-869d-e1462a5302ae tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lazy-loading 'flavor' on Instance uuid 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:24:54.361983 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c1dc5ad1-80b1-4915-8a79-fd449123fc9f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:54.362685 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c1dc5ad1-80b1-4915-8a79-fd449123fc9f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:54.370173 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c1dc5ad1-80b1-4915-8a79-fd449123fc9f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:54.370916 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c1dc5ad1-80b1-4915-8a79-fd449123fc9f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:54.371347 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c1dc5ad1-80b1-4915-8a79-fd449123fc9f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:54.371812 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c1dc5ad1-80b1-4915-8a79-fd449123fc9f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:54.530500 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c1dc5ad1-80b1-4915-8a79-fd449123fc9f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:54.539207 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c1dc5ad1-80b1-4915-8a79-fd449123fc9f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.182153 May 13 13:24:54.539795 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 121/231] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:54 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:24:54.873136 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9ab8b215-577f-4af3-869d-e1462a5302ae tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "POST /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6/action" status: 202 len: 0 microversion: 2.20 time: 0.626397 May 13 13:24:54.873763 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 111/232] 10.222.0.13 () {62 vars in 1318 bytes} [Fri May 13 13:24:54 2022] POST /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6/action => generated 0 bytes in 628 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 13:24:54.881944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2097758f-841c-4421-8481-68a1a6f919fc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:54.884245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2097758f-841c-4421-8481-68a1a6f919fc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:54.889647 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2097758f-841c-4421-8481-68a1a6f919fc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:54.890094 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2097758f-841c-4421-8481-68a1a6f919fc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:54.890898 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2097758f-841c-4421-8481-68a1a6f919fc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:54.891580 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2097758f-841c-4421-8481-68a1a6f919fc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:55.021476 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2097758f-841c-4421-8481-68a1a6f919fc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:55.029887 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2097758f-841c-4421-8481-68a1a6f919fc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:55.031422 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2097758f-841c-4421-8481-68a1a6f919fc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:55.032611 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2097758f-841c-4421-8481-68a1a6f919fc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1725 microversion: 2.20 time: 0.154521 May 13 13:24:55.033160 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 122/233] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:24:54 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:24:55.557603 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-de72d9ce-22a6-4d59-a1c1-34b00ebf78e1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:55.558322 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-de72d9ce-22a6-4d59-a1c1-34b00ebf78e1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:55.565272 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-de72d9ce-22a6-4d59-a1c1-34b00ebf78e1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:55.565714 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-de72d9ce-22a6-4d59-a1c1-34b00ebf78e1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:55.566500 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-de72d9ce-22a6-4d59-a1c1-34b00ebf78e1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:55.566924 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-de72d9ce-22a6-4d59-a1c1-34b00ebf78e1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:55.698798 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-de72d9ce-22a6-4d59-a1c1-34b00ebf78e1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:55.706099 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-de72d9ce-22a6-4d59-a1c1-34b00ebf78e1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.153144 May 13 13:24:55.706684 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 112/234] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:55 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:56.050644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6d0ef9c2-4a5d-4b1a-ad93-63ff415edff7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:56.051249 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6d0ef9c2-4a5d-4b1a-ad93-63ff415edff7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:56.057577 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6d0ef9c2-4a5d-4b1a-ad93-63ff415edff7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:56.058027 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6d0ef9c2-4a5d-4b1a-ad93-63ff415edff7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:56.058825 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6d0ef9c2-4a5d-4b1a-ad93-63ff415edff7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:56.059272 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6d0ef9c2-4a5d-4b1a-ad93-63ff415edff7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:56.189461 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6d0ef9c2-4a5d-4b1a-ad93-63ff415edff7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:56.197758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6d0ef9c2-4a5d-4b1a-ad93-63ff415edff7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:56.199337 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6d0ef9c2-4a5d-4b1a-ad93-63ff415edff7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:56.200522 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6d0ef9c2-4a5d-4b1a-ad93-63ff415edff7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1725 microversion: 2.20 time: 0.153769 May 13 13:24:56.201088 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 123/235] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:24:56 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:24:56.724738 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3aef64b9-5201-4bc2-992b-be33ae9b80ea tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:56.725348 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3aef64b9-5201-4bc2-992b-be33ae9b80ea tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:56.731821 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3aef64b9-5201-4bc2-992b-be33ae9b80ea tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:56.732774 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3aef64b9-5201-4bc2-992b-be33ae9b80ea tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:56.733541 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3aef64b9-5201-4bc2-992b-be33ae9b80ea tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:56.733978 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3aef64b9-5201-4bc2-992b-be33ae9b80ea tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:56.873368 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3aef64b9-5201-4bc2-992b-be33ae9b80ea tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:56.880762 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3aef64b9-5201-4bc2-992b-be33ae9b80ea tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.159786 May 13 13:24:56.881323 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 113/236] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:56 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:57.220213 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e44ead68-7738-4c8c-8abb-1de44829a452 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:57.220815 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e44ead68-7738-4c8c-8abb-1de44829a452 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:57.227110 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e44ead68-7738-4c8c-8abb-1de44829a452 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:57.227583 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e44ead68-7738-4c8c-8abb-1de44829a452 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:57.228341 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e44ead68-7738-4c8c-8abb-1de44829a452 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:57.228769 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e44ead68-7738-4c8c-8abb-1de44829a452 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:57.360704 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e44ead68-7738-4c8c-8abb-1de44829a452 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:57.368675 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e44ead68-7738-4c8c-8abb-1de44829a452 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:57.370459 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e44ead68-7738-4c8c-8abb-1de44829a452 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:57.371784 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e44ead68-7738-4c8c-8abb-1de44829a452 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1725 microversion: 2.20 time: 0.156006 May 13 13:24:57.376975 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 124/237] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:24:57 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:24:57.898937 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-748a4fca-bd39-4d4d-911f-2d585509fdc2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:57.899541 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-748a4fca-bd39-4d4d-911f-2d585509fdc2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:57.906496 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-748a4fca-bd39-4d4d-911f-2d585509fdc2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:57.906950 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-748a4fca-bd39-4d4d-911f-2d585509fdc2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:57.907724 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-748a4fca-bd39-4d4d-911f-2d585509fdc2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:57.908157 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-748a4fca-bd39-4d4d-911f-2d585509fdc2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:58.045589 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-748a4fca-bd39-4d4d-911f-2d585509fdc2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:58.052477 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-748a4fca-bd39-4d4d-911f-2d585509fdc2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.157097 May 13 13:24:58.053075 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 114/238] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:57 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:58.393331 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4f2b3cd9-23e5-42cf-ac8f-ba339da9141f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:58.394213 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4f2b3cd9-23e5-42cf-ac8f-ba339da9141f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:58.402672 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4f2b3cd9-23e5-42cf-ac8f-ba339da9141f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:58.404603 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4f2b3cd9-23e5-42cf-ac8f-ba339da9141f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:58.405618 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4f2b3cd9-23e5-42cf-ac8f-ba339da9141f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:58.406062 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4f2b3cd9-23e5-42cf-ac8f-ba339da9141f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:58.544442 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4f2b3cd9-23e5-42cf-ac8f-ba339da9141f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:58.552926 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4f2b3cd9-23e5-42cf-ac8f-ba339da9141f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:58.554453 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4f2b3cd9-23e5-42cf-ac8f-ba339da9141f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:58.555664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4f2b3cd9-23e5-42cf-ac8f-ba339da9141f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1725 microversion: 2.20 time: 0.168298 May 13 13:24:58.556223 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 125/239] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:24:58 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:24:59.068760 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4ebb901a-ef2d-4ef2-b2ce-a63253f3185f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:59.069345 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4ebb901a-ef2d-4ef2-b2ce-a63253f3185f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:59.076315 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4ebb901a-ef2d-4ef2-b2ce-a63253f3185f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:59.077278 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4ebb901a-ef2d-4ef2-b2ce-a63253f3185f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:59.077424 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4ebb901a-ef2d-4ef2-b2ce-a63253f3185f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:59.077855 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4ebb901a-ef2d-4ef2-b2ce-a63253f3185f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:59.211493 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4ebb901a-ef2d-4ef2-b2ce-a63253f3185f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:59.221069 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4ebb901a-ef2d-4ef2-b2ce-a63253f3185f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.156061 May 13 13:24:59.221683 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 115/240] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:24:59 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:24:59.574075 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3b43585c-afb1-4e84-a788-b6dceee432af tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:24:59.574759 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3b43585c-afb1-4e84-a788-b6dceee432af tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:24:59.581326 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3b43585c-afb1-4e84-a788-b6dceee432af tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:59.581798 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3b43585c-afb1-4e84-a788-b6dceee432af tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:59.582621 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3b43585c-afb1-4e84-a788-b6dceee432af tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:59.583081 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3b43585c-afb1-4e84-a788-b6dceee432af tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:59.733844 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3b43585c-afb1-4e84-a788-b6dceee432af tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:59.743286 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3b43585c-afb1-4e84-a788-b6dceee432af tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:59.745066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3b43585c-afb1-4e84-a788-b6dceee432af tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:24:59.746486 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3b43585c-afb1-4e84-a788-b6dceee432af tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1725 microversion: 2.20 time: 0.176234 May 13 13:24:59.747170 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 126/241] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:24:59 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:00.238000 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-112963b3-31a1-41d4-b7ed-43d31e113bfb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:00.238675 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-112963b3-31a1-41d4-b7ed-43d31e113bfb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:00.245265 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-112963b3-31a1-41d4-b7ed-43d31e113bfb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:00.245715 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-112963b3-31a1-41d4-b7ed-43d31e113bfb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:00.246524 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-112963b3-31a1-41d4-b7ed-43d31e113bfb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:00.246965 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-112963b3-31a1-41d4-b7ed-43d31e113bfb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:00.378616 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-112963b3-31a1-41d4-b7ed-43d31e113bfb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:00.386142 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-112963b3-31a1-41d4-b7ed-43d31e113bfb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.151979 May 13 13:25:00.386808 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 116/242] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:00 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:00.766664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-26158086-abaf-40f2-ad0f-a57fcf2d1435 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:00.767259 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-26158086-abaf-40f2-ad0f-a57fcf2d1435 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:00.774087 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-26158086-abaf-40f2-ad0f-a57fcf2d1435 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:00.774473 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-26158086-abaf-40f2-ad0f-a57fcf2d1435 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:00.775237 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-26158086-abaf-40f2-ad0f-a57fcf2d1435 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:00.775671 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-26158086-abaf-40f2-ad0f-a57fcf2d1435 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:00.910093 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-26158086-abaf-40f2-ad0f-a57fcf2d1435 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:00.918052 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-26158086-abaf-40f2-ad0f-a57fcf2d1435 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:00.920278 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-26158086-abaf-40f2-ad0f-a57fcf2d1435 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:00.921632 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-26158086-abaf-40f2-ad0f-a57fcf2d1435 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1725 microversion: 2.20 time: 0.159114 May 13 13:25:00.922292 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 127/243] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:00 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:01.403481 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3a6ab59d-4c0b-4a0c-a733-6746f3311f93 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:01.404418 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3a6ab59d-4c0b-4a0c-a733-6746f3311f93 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:01.411153 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3a6ab59d-4c0b-4a0c-a733-6746f3311f93 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:01.411681 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3a6ab59d-4c0b-4a0c-a733-6746f3311f93 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:01.412462 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3a6ab59d-4c0b-4a0c-a733-6746f3311f93 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:01.412895 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3a6ab59d-4c0b-4a0c-a733-6746f3311f93 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:01.551538 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3a6ab59d-4c0b-4a0c-a733-6746f3311f93 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:01.559209 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3a6ab59d-4c0b-4a0c-a733-6746f3311f93 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.159525 May 13 13:25:01.559829 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 117/244] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:01 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:01.944493 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ab314209-5436-438d-b255-a55753411e12 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:01.945280 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ab314209-5436-438d-b255-a55753411e12 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:01.952243 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ab314209-5436-438d-b255-a55753411e12 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:01.952693 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ab314209-5436-438d-b255-a55753411e12 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:01.953480 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ab314209-5436-438d-b255-a55753411e12 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:01.953912 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ab314209-5436-438d-b255-a55753411e12 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:02.091008 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ab314209-5436-438d-b255-a55753411e12 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:02.100134 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ab314209-5436-438d-b255-a55753411e12 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:02.101624 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ab314209-5436-438d-b255-a55753411e12 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:02.102811 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ab314209-5436-438d-b255-a55753411e12 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1725 microversion: 2.20 time: 0.166153 May 13 13:25:02.103368 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 128/245] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:01 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:02.576897 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0dbf3b61-27cd-43bf-ac53-8f9181d42f14 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:02.577506 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0dbf3b61-27cd-43bf-ac53-8f9181d42f14 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:02.583897 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0dbf3b61-27cd-43bf-ac53-8f9181d42f14 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:02.584339 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0dbf3b61-27cd-43bf-ac53-8f9181d42f14 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:02.585103 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0dbf3b61-27cd-43bf-ac53-8f9181d42f14 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:02.585536 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0dbf3b61-27cd-43bf-ac53-8f9181d42f14 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:02.721456 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0dbf3b61-27cd-43bf-ac53-8f9181d42f14 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:02.729158 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0dbf3b61-27cd-43bf-ac53-8f9181d42f14 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.156231 May 13 13:25:02.729724 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 118/246] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:02 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:03.123534 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c083b9a5-c91f-4b94-a2ab-47c575ff9167 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:03.123534 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c083b9a5-c91f-4b94-a2ab-47c575ff9167 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:03.128095 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c083b9a5-c91f-4b94-a2ab-47c575ff9167 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:03.128537 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c083b9a5-c91f-4b94-a2ab-47c575ff9167 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:03.129297 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c083b9a5-c91f-4b94-a2ab-47c575ff9167 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:03.129719 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c083b9a5-c91f-4b94-a2ab-47c575ff9167 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:03.260741 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c083b9a5-c91f-4b94-a2ab-47c575ff9167 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:03.269757 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c083b9a5-c91f-4b94-a2ab-47c575ff9167 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:03.271302 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c083b9a5-c91f-4b94-a2ab-47c575ff9167 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:03.272530 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c083b9a5-c91f-4b94-a2ab-47c575ff9167 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1725 microversion: 2.20 time: 0.155352 May 13 13:25:03.273041 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 129/247] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:03 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:03.746688 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-34eb2587-362c-4240-a3e6-056efe54be41 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:03.747464 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-34eb2587-362c-4240-a3e6-056efe54be41 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:03.754004 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34eb2587-362c-4240-a3e6-056efe54be41 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:03.754528 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34eb2587-362c-4240-a3e6-056efe54be41 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:03.755331 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34eb2587-362c-4240-a3e6-056efe54be41 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:03.756032 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34eb2587-362c-4240-a3e6-056efe54be41 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:03.896409 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-34eb2587-362c-4240-a3e6-056efe54be41 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:03.904173 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-34eb2587-362c-4240-a3e6-056efe54be41 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1501 microversion: 2.1 time: 0.161064 May 13 13:25:03.904748 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 119/248] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:03 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:03.921073 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-36fddde1-7ee4-40fe-a25a-5377e127c0b5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46d97735-e6a5-4d04-b915-3924ac8bfa03"}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:03.922222 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-36fddde1-7ee4-40fe-a25a-5377e127c0b5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:03.928240 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-36fddde1-7ee4-40fe-a25a-5377e127c0b5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:03.928681 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-36fddde1-7ee4-40fe-a25a-5377e127c0b5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:03.929441 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-36fddde1-7ee4-40fe-a25a-5377e127c0b5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:03.929864 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-36fddde1-7ee4-40fe-a25a-5377e127c0b5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:03.954037 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-36fddde1-7ee4-40fe-a25a-5377e127c0b5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] HTTP exception thrown: Cannot 'attach_volume' instance 75885842-8f4b-43a8-aa30-0da326e4f6e3 while it is in vm_state rescued May 13 13:25:03.955923 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-36fddde1-7ee4-40fe-a25a-5377e127c0b5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Request method failure captured: May 13 13:25:03.955923 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: POST /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3/os-volume_attachments HTTP/1.1 May 13 13:25:03.955923 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:25:03.955923 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:25:03.955923 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:25:03.955923 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 74 May 13 13:25:03.955923 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:25:03.955923 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:25:03.955923 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:25:03.955923 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:25:03.955923 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiflu9j1w3aWMYNeaepMtfghSN45R1rpudn7y88iUBZfUo5TNiFrmf5PObcCzu3o7oE_Enr4-R9iUAQxm1SnylSai1-YY48Gzh5RYsKm6vqseENGLkqnAve6m4Gli7NdrEPkNnXAnVdgHIyQUn7lwQz8bRkj2auUPtcvSEbefYCErLs1g May 13 13:25:03.955923 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:25:03.955923 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:25:03.955923 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:25:03.955923 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:25:03.955923 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:25:03.955923 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:25:03.955923 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: a0e165a1f0d34fca81de45a48c6cdbb9 May 13 13:25:03.955923 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2055800790 May 13 13:25:03.955923 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:25:03.955923 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:25:03.959423 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a0e165a1f0d34fca81de45a48c6cdbb9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a0e165a1f0d34fca81de45a48c6cdbb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a0e165a1f0d34fca81de45a48c6cdbb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a0e165a1f0d34fca81de45a48c6cdbb9"}]}] May 13 13:25:03.959423 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2055800790 May 13 13:25:03.959423 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: a0e165a1f0d34fca81de45a48c6cdbb9 May 13 13:25:03.959423 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2055800790 May 13 13:25:03.959423 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-ServerRescueNegativeTestJSON-2055800790-project May 13 13:25:03.959423 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:25:03.959423 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:25:03.959423 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: 805e8e6c39f94d3bbcf60930492e297c May 13 13:25:03.959423 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2055800790-project May 13 13:25:03.959423 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: May 13 13:25:03.959423 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {"volumeAttachment": {"volumeId": "46d97735-e6a5-4d04-b915-3924ac8bfa03"}} May 13 13:25:03.959423 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: > May 13 13:25:03.960320 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Cannot 'attach_volume' instance 75885842-8f4b-43a8-aa30-0da326e4f6e3 while it is in vm_state rescued May 13 13:25:03.960320 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'server_id': '75885842-8f4b-43a8-aa30-0da326e4f6e3', 'body': {'volumeAttachment': {'volumeId': '46d97735-e6a5-4d04-b915-3924ac8bfa03'}}} May 13 13:25:03.960320 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:25:03.960320 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:25:03.960320 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 13 13:25:03.960320 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 13 13:25:03.960320 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 13:25:03.960320 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 13:25:03.960320 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 13 13:25:03.960320 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 13 13:25:03.960320 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 75885842-8f4b-43a8-aa30-0da326e4f6e3 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 13 13:25:03.960320 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:25:03.960320 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:25:03.960320 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:25:03.960320 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:25:03.960320 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:25:03.960320 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:25:03.960320 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:25:03.960320 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:25:03.961953 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:25:03.961953 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:25:03.961953 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 13:25:03.961953 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:25:03.961953 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 13:25:03.961953 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:25:03.961953 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 13:25:03.961953 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:25:03.961953 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 13 13:25:03.961953 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 13 13:25:03.961953 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 13 13:25:03.961953 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 13 13:25:03.961953 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 75885842-8f4b-43a8-aa30-0da326e4f6e3 while it is in vm_state rescued May 13 13:25:03.961953 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:25:03.961953 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:25:03.961953 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:25:03.961953 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:25:03.961953 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:25:03.961953 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:25:03.963507 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:25:03.963507 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:25:03.963507 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 75885842-8f4b-43a8-aa30-0da326e4f6e3 while it is in vm_state rescued May 13 13:25:03.963507 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:25:03.963507 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-36fddde1-7ee4-40fe-a25a-5377e127c0b5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Returning 409 to user: Cannot 'attach_volume' instance 75885842-8f4b-43a8-aa30-0da326e4f6e3 while it is in vm_state rescued {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:25:03.963507 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-36fddde1-7ee4-40fe-a25a-5377e127c0b5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "POST /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040730 May 13 13:25:03.963507 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 130/249] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 13 13:25:03 2022] POST /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 13 13:25:03.967998 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-48189473-7c4c-45d5-8886-4d94288e4176 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:03.968530 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-48189473-7c4c-45d5-8886-4d94288e4176 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:03.974681 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48189473-7c4c-45d5-8886-4d94288e4176 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:03.975247 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48189473-7c4c-45d5-8886-4d94288e4176 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:03.976097 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48189473-7c4c-45d5-8886-4d94288e4176 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:03.976605 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48189473-7c4c-45d5-8886-4d94288e4176 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:04.180413 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-48189473-7c4c-45d5-8886-4d94288e4176 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "POST /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3/action" status: 202 len: 0 microversion: 2.1 time: 0.216499 May 13 13:25:04.184209 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 120/250] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 13 13:25:03 2022] POST /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 13:25:04.193481 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6aea7808-bce1-4480-bbf7-e1b44e8d3cc6 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:04.193481 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6aea7808-bce1-4480-bbf7-e1b44e8d3cc6 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:04.197956 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6aea7808-bce1-4480-bbf7-e1b44e8d3cc6 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:04.198486 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6aea7808-bce1-4480-bbf7-e1b44e8d3cc6 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:04.199268 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6aea7808-bce1-4480-bbf7-e1b44e8d3cc6 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:04.199860 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6aea7808-bce1-4480-bbf7-e1b44e8d3cc6 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:04.293387 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-654867fc-bb93-447e-a459-7160a396e0b7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:04.294814 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-654867fc-bb93-447e-a459-7160a396e0b7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:04.301255 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-654867fc-bb93-447e-a459-7160a396e0b7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:04.301790 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-654867fc-bb93-447e-a459-7160a396e0b7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:04.302683 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-654867fc-bb93-447e-a459-7160a396e0b7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:04.303629 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-654867fc-bb93-447e-a459-7160a396e0b7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:04.334433 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6aea7808-bce1-4480-bbf7-e1b44e8d3cc6 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:04.342572 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6aea7808-bce1-4480-bbf7-e1b44e8d3cc6 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1509 microversion: 2.1 time: 0.155996 May 13 13:25:04.343362 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 131/251] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:04 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:04.445932 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-654867fc-bb93-447e-a459-7160a396e0b7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:04.455362 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-654867fc-bb93-447e-a459-7160a396e0b7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:04.456895 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-654867fc-bb93-447e-a459-7160a396e0b7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:04.458050 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-654867fc-bb93-447e-a459-7160a396e0b7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1725 microversion: 2.20 time: 0.168979 May 13 13:25:04.459476 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 121/252] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:04 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:25:05.362125 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-03fbbe98-b15c-465b-9332-a43a1a4abb86 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:05.362125 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-03fbbe98-b15c-465b-9332-a43a1a4abb86 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:05.368248 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-03fbbe98-b15c-465b-9332-a43a1a4abb86 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:05.368690 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-03fbbe98-b15c-465b-9332-a43a1a4abb86 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:05.369458 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-03fbbe98-b15c-465b-9332-a43a1a4abb86 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:05.369891 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-03fbbe98-b15c-465b-9332-a43a1a4abb86 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:05.477023 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6ea0e6d8-7253-40a5-b87d-bfdb94743c28 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:05.477645 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6ea0e6d8-7253-40a5-b87d-bfdb94743c28 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:05.484144 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6ea0e6d8-7253-40a5-b87d-bfdb94743c28 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:05.484590 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6ea0e6d8-7253-40a5-b87d-bfdb94743c28 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:05.485393 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6ea0e6d8-7253-40a5-b87d-bfdb94743c28 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:05.485828 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6ea0e6d8-7253-40a5-b87d-bfdb94743c28 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:05.504523 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-03fbbe98-b15c-465b-9332-a43a1a4abb86 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:05.512410 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-03fbbe98-b15c-465b-9332-a43a1a4abb86 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1509 microversion: 2.1 time: 0.155353 May 13 13:25:05.522627 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 132/253] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:05 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:05.634929 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6ea0e6d8-7253-40a5-b87d-bfdb94743c28 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:05.643814 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6ea0e6d8-7253-40a5-b87d-bfdb94743c28 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:05.645347 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6ea0e6d8-7253-40a5-b87d-bfdb94743c28 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:05.646540 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6ea0e6d8-7253-40a5-b87d-bfdb94743c28 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1725 microversion: 2.20 time: 0.173656 May 13 13:25:05.647107 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 122/254] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:05 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:25:06.530224 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b65ca5f5-a20c-4b94-a56b-6c720c5fca1e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:06.530897 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b65ca5f5-a20c-4b94-a56b-6c720c5fca1e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:06.537795 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b65ca5f5-a20c-4b94-a56b-6c720c5fca1e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:06.538270 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b65ca5f5-a20c-4b94-a56b-6c720c5fca1e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:06.539127 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b65ca5f5-a20c-4b94-a56b-6c720c5fca1e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:06.539614 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b65ca5f5-a20c-4b94-a56b-6c720c5fca1e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:06.665866 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7877f816-ab65-4835-97b6-4d79ffa13ec9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:06.672427 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7877f816-ab65-4835-97b6-4d79ffa13ec9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:06.677085 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b65ca5f5-a20c-4b94-a56b-6c720c5fca1e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:06.680892 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7877f816-ab65-4835-97b6-4d79ffa13ec9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:06.681341 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7877f816-ab65-4835-97b6-4d79ffa13ec9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:06.682127 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7877f816-ab65-4835-97b6-4d79ffa13ec9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:06.682680 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7877f816-ab65-4835-97b6-4d79ffa13ec9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:06.688388 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b65ca5f5-a20c-4b94-a56b-6c720c5fca1e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1509 microversion: 2.1 time: 0.161665 May 13 13:25:06.698174 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 133/255] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:06 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:06.812821 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7877f816-ab65-4835-97b6-4d79ffa13ec9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:06.820743 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7877f816-ab65-4835-97b6-4d79ffa13ec9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:06.822274 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7877f816-ab65-4835-97b6-4d79ffa13ec9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:06.823426 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7877f816-ab65-4835-97b6-4d79ffa13ec9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1725 microversion: 2.20 time: 0.162430 May 13 13:25:06.823988 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 123/256] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:06 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:25:07.706803 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-9216c39e-1600-44a0-beb0-df91e3ab0e4e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:07.707415 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-9216c39e-1600-44a0-beb0-df91e3ab0e4e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:07.714256 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9216c39e-1600-44a0-beb0-df91e3ab0e4e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:07.714709 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9216c39e-1600-44a0-beb0-df91e3ab0e4e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:07.715483 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9216c39e-1600-44a0-beb0-df91e3ab0e4e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:07.715915 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9216c39e-1600-44a0-beb0-df91e3ab0e4e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:07.843546 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c177a3e9-299b-4d15-b542-fb5e6c719d10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:07.844166 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c177a3e9-299b-4d15-b542-fb5e6c719d10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:07.851147 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c177a3e9-299b-4d15-b542-fb5e6c719d10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:07.851602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c177a3e9-299b-4d15-b542-fb5e6c719d10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:07.852387 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c177a3e9-299b-4d15-b542-fb5e6c719d10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:07.852824 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c177a3e9-299b-4d15-b542-fb5e6c719d10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:07.872948 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-9216c39e-1600-44a0-beb0-df91e3ab0e4e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:07.883235 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-9216c39e-1600-44a0-beb0-df91e3ab0e4e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1509 microversion: 2.1 time: 0.180032 May 13 13:25:07.883829 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 134/257] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:07 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1509 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:07.994230 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c177a3e9-299b-4d15-b542-fb5e6c719d10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:08.003890 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c177a3e9-299b-4d15-b542-fb5e6c719d10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:08.005626 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c177a3e9-299b-4d15-b542-fb5e6c719d10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:08.007111 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c177a3e9-299b-4d15-b542-fb5e6c719d10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1725 microversion: 2.20 time: 0.169516 May 13 13:25:08.018651 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 124/258] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:07 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:08.901085 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-9c98ca67-c921-45f3-a975-99436ec7a07b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:08.901745 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-9c98ca67-c921-45f3-a975-99436ec7a07b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:08.908616 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9c98ca67-c921-45f3-a975-99436ec7a07b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:08.909065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9c98ca67-c921-45f3-a975-99436ec7a07b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:08.909840 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9c98ca67-c921-45f3-a975-99436ec7a07b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:08.910306 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9c98ca67-c921-45f3-a975-99436ec7a07b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:09.035693 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b59f14bd-2cfb-46c2-bebf-5af325ce7fe9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:09.036297 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b59f14bd-2cfb-46c2-bebf-5af325ce7fe9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:09.044865 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-9c98ca67-c921-45f3-a975-99436ec7a07b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:09.045636 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b59f14bd-2cfb-46c2-bebf-5af325ce7fe9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:09.046086 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b59f14bd-2cfb-46c2-bebf-5af325ce7fe9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:09.046891 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b59f14bd-2cfb-46c2-bebf-5af325ce7fe9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:09.047384 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b59f14bd-2cfb-46c2-bebf-5af325ce7fe9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:09.052614 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-9c98ca67-c921-45f3-a975-99436ec7a07b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1509 microversion: 2.1 time: 0.155390 May 13 13:25:09.053188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 135/259] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:08 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:09.184565 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b59f14bd-2cfb-46c2-bebf-5af325ce7fe9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:09.193572 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b59f14bd-2cfb-46c2-bebf-5af325ce7fe9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:09.195115 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b59f14bd-2cfb-46c2-bebf-5af325ce7fe9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:09.196328 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b59f14bd-2cfb-46c2-bebf-5af325ce7fe9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1725 microversion: 2.20 time: 0.164659 May 13 13:25:09.199497 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 125/260] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:09 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:25:10.070759 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d5fa4025-f176-4e51-a181-aa6dceb01564 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:10.071395 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d5fa4025-f176-4e51-a181-aa6dceb01564 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:10.078755 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d5fa4025-f176-4e51-a181-aa6dceb01564 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:10.079198 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d5fa4025-f176-4e51-a181-aa6dceb01564 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:10.079974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d5fa4025-f176-4e51-a181-aa6dceb01564 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:10.080401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d5fa4025-f176-4e51-a181-aa6dceb01564 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:10.215123 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5582d7ad-7843-4024-9648-a6e8466eba66 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:10.215735 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5582d7ad-7843-4024-9648-a6e8466eba66 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:10.225503 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5582d7ad-7843-4024-9648-a6e8466eba66 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:10.225953 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5582d7ad-7843-4024-9648-a6e8466eba66 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:10.226749 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5582d7ad-7843-4024-9648-a6e8466eba66 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:10.227258 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5582d7ad-7843-4024-9648-a6e8466eba66 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:10.227406 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d5fa4025-f176-4e51-a181-aa6dceb01564 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:10.235970 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d5fa4025-f176-4e51-a181-aa6dceb01564 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1509 microversion: 2.1 time: 0.169083 May 13 13:25:10.237153 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 136/261] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:10 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:10.407926 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5582d7ad-7843-4024-9648-a6e8466eba66 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:10.415592 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5582d7ad-7843-4024-9648-a6e8466eba66 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:10.417082 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5582d7ad-7843-4024-9648-a6e8466eba66 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:10.418324 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5582d7ad-7843-4024-9648-a6e8466eba66 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1725 microversion: 2.20 time: 0.207262 May 13 13:25:10.418882 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 126/262] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:10 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:25:11.256871 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b63764cc-403a-4110-9f07-b2d5008f2419 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:11.257613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b63764cc-403a-4110-9f07-b2d5008f2419 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:11.265253 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b63764cc-403a-4110-9f07-b2d5008f2419 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:11.265617 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b63764cc-403a-4110-9f07-b2d5008f2419 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:11.266418 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b63764cc-403a-4110-9f07-b2d5008f2419 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:11.266848 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b63764cc-403a-4110-9f07-b2d5008f2419 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:11.399434 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b63764cc-403a-4110-9f07-b2d5008f2419 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:11.406998 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b63764cc-403a-4110-9f07-b2d5008f2419 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1509 microversion: 2.1 time: 0.154334 May 13 13:25:11.413357 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 137/263] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:11 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:11.437387 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-010739be-0bfd-42da-907b-c6610173a0d8 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:11.438601 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-010739be-0bfd-42da-907b-c6610173a0d8 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:11.446589 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-010739be-0bfd-42da-907b-c6610173a0d8 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:11.447299 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-010739be-0bfd-42da-907b-c6610173a0d8 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:11.448130 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-010739be-0bfd-42da-907b-c6610173a0d8 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:11.448643 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-010739be-0bfd-42da-907b-c6610173a0d8 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:11.589875 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-010739be-0bfd-42da-907b-c6610173a0d8 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:11.600461 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-010739be-0bfd-42da-907b-c6610173a0d8 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:11.601989 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-010739be-0bfd-42da-907b-c6610173a0d8 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:11.603185 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-010739be-0bfd-42da-907b-c6610173a0d8 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1725 microversion: 2.20 time: 0.170288 May 13 13:25:11.603746 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 127/264] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:11 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:11.643392 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0f98f613-ea34-4041-8da5-68749487a206 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:11.649374 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0f98f613-ea34-4041-8da5-68749487a206 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:11.656162 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0f98f613-ea34-4041-8da5-68749487a206 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:11.709857 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0f98f613-ea34-4041-8da5-68749487a206 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Going to try to stop instance {{(pid=117721) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 13 13:25:11.905604 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0f98f613-ea34-4041-8da5-68749487a206 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "POST /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86/action" status: 202 len: 0 microversion: 2.1 time: 0.265879 May 13 13:25:11.906277 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 138/265] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 13 13:25:11 2022] POST /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:25:11.914483 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7ac2352f-2e11-4ea4-94b0-4efebfae591c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:11.915090 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7ac2352f-2e11-4ea4-94b0-4efebfae591c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:11.922412 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7ac2352f-2e11-4ea4-94b0-4efebfae591c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:11.922857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7ac2352f-2e11-4ea4-94b0-4efebfae591c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:11.923618 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7ac2352f-2e11-4ea4-94b0-4efebfae591c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:11.924055 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7ac2352f-2e11-4ea4-94b0-4efebfae591c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:12.057322 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7ac2352f-2e11-4ea4-94b0-4efebfae591c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:12.066265 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7ac2352f-2e11-4ea4-94b0-4efebfae591c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.155573 May 13 13:25:12.066851 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 128/266] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:11 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:12.429093 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6af5c6fd-342a-47e0-b53e-fedf45da10c3 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:12.429781 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6af5c6fd-342a-47e0-b53e-fedf45da10c3 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:12.437417 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6af5c6fd-342a-47e0-b53e-fedf45da10c3 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:12.437858 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6af5c6fd-342a-47e0-b53e-fedf45da10c3 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:12.438655 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6af5c6fd-342a-47e0-b53e-fedf45da10c3 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:12.439082 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6af5c6fd-342a-47e0-b53e-fedf45da10c3 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:12.570704 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6af5c6fd-342a-47e0-b53e-fedf45da10c3 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:12.579165 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6af5c6fd-342a-47e0-b53e-fedf45da10c3 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1509 microversion: 2.1 time: 0.154280 May 13 13:25:12.580107 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 139/267] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:12 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:12.620936 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-dc52c3c4-0b8e-4200-8765-7d8216c7a303 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:12.621575 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-dc52c3c4-0b8e-4200-8765-7d8216c7a303 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:12.628041 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dc52c3c4-0b8e-4200-8765-7d8216c7a303 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:12.628481 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dc52c3c4-0b8e-4200-8765-7d8216c7a303 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:12.629250 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dc52c3c4-0b8e-4200-8765-7d8216c7a303 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:12.629676 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dc52c3c4-0b8e-4200-8765-7d8216c7a303 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:12.764210 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dc52c3c4-0b8e-4200-8765-7d8216c7a303 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:12.772326 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dc52c3c4-0b8e-4200-8765-7d8216c7a303 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:12.773815 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dc52c3c4-0b8e-4200-8765-7d8216c7a303 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:12.775004 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-dc52c3c4-0b8e-4200-8765-7d8216c7a303 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1725 microversion: 2.20 time: 0.157985 May 13 13:25:12.775567 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 129/268] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:12 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:25:13.084193 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f986ad69-93ff-4098-9f2a-3a3187ddf846 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:13.084791 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f986ad69-93ff-4098-9f2a-3a3187ddf846 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:13.091941 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f986ad69-93ff-4098-9f2a-3a3187ddf846 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:13.092471 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f986ad69-93ff-4098-9f2a-3a3187ddf846 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:13.093245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f986ad69-93ff-4098-9f2a-3a3187ddf846 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:13.093672 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f986ad69-93ff-4098-9f2a-3a3187ddf846 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:13.228837 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f986ad69-93ff-4098-9f2a-3a3187ddf846 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:13.238720 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f986ad69-93ff-4098-9f2a-3a3187ddf846 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.158414 May 13 13:25:13.239964 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 140/269] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:13 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:13.597860 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e4f328a5-be37-457c-bc7a-b23152c049d8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:13.598476 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e4f328a5-be37-457c-bc7a-b23152c049d8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:13.604303 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e4f328a5-be37-457c-bc7a-b23152c049d8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:13.604745 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e4f328a5-be37-457c-bc7a-b23152c049d8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:13.605499 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e4f328a5-be37-457c-bc7a-b23152c049d8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:13.605926 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e4f328a5-be37-457c-bc7a-b23152c049d8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:13.736561 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e4f328a5-be37-457c-bc7a-b23152c049d8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:13.744048 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e4f328a5-be37-457c-bc7a-b23152c049d8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1509 microversion: 2.1 time: 0.150116 May 13 13:25:13.744622 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 130/270] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:13 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:13.793451 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d23a5afe-b187-4379-86c8-c1c6c97fc169 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:13.794045 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d23a5afe-b187-4379-86c8-c1c6c97fc169 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:13.800674 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d23a5afe-b187-4379-86c8-c1c6c97fc169 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:13.801108 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d23a5afe-b187-4379-86c8-c1c6c97fc169 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:13.801859 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d23a5afe-b187-4379-86c8-c1c6c97fc169 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:13.802312 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d23a5afe-b187-4379-86c8-c1c6c97fc169 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:13.932495 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d23a5afe-b187-4379-86c8-c1c6c97fc169 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:13.940852 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d23a5afe-b187-4379-86c8-c1c6c97fc169 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:13.942375 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d23a5afe-b187-4379-86c8-c1c6c97fc169 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:13.943602 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d23a5afe-b187-4379-86c8-c1c6c97fc169 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1725 microversion: 2.20 time: 0.154073 May 13 13:25:13.944162 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 141/271] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:13 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:14.256827 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d0dace39-b99d-43d1-844f-f5705c8bfedf tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:14.257426 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d0dace39-b99d-43d1-844f-f5705c8bfedf tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:14.263604 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d0dace39-b99d-43d1-844f-f5705c8bfedf tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:14.264042 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d0dace39-b99d-43d1-844f-f5705c8bfedf tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:14.264800 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d0dace39-b99d-43d1-844f-f5705c8bfedf tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:14.265232 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d0dace39-b99d-43d1-844f-f5705c8bfedf tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:14.398409 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d0dace39-b99d-43d1-844f-f5705c8bfedf tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:14.406220 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d0dace39-b99d-43d1-844f-f5705c8bfedf tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.153352 May 13 13:25:14.406803 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 131/272] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:14 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:14.762335 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-9ac84b81-deb4-41ef-ba1e-d5fc878b50b2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:14.763430 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-9ac84b81-deb4-41ef-ba1e-d5fc878b50b2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:14.769461 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9ac84b81-deb4-41ef-ba1e-d5fc878b50b2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:14.769898 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9ac84b81-deb4-41ef-ba1e-d5fc878b50b2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:14.770692 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9ac84b81-deb4-41ef-ba1e-d5fc878b50b2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:14.771115 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9ac84b81-deb4-41ef-ba1e-d5fc878b50b2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:14.905029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-9ac84b81-deb4-41ef-ba1e-d5fc878b50b2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:14.913012 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-9ac84b81-deb4-41ef-ba1e-d5fc878b50b2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1509 microversion: 2.1 time: 0.154589 May 13 13:25:14.913588 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 142/273] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:14 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:14.963233 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d9d9531f-80ac-495f-b943-eb8e3f0efb0a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:14.963845 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d9d9531f-80ac-495f-b943-eb8e3f0efb0a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:14.970510 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d9d9531f-80ac-495f-b943-eb8e3f0efb0a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:14.970948 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d9d9531f-80ac-495f-b943-eb8e3f0efb0a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:14.971702 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d9d9531f-80ac-495f-b943-eb8e3f0efb0a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:14.972124 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d9d9531f-80ac-495f-b943-eb8e3f0efb0a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:15.099170 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d9d9531f-80ac-495f-b943-eb8e3f0efb0a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:15.107374 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d9d9531f-80ac-495f-b943-eb8e3f0efb0a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:15.108883 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d9d9531f-80ac-495f-b943-eb8e3f0efb0a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:15.110072 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d9d9531f-80ac-495f-b943-eb8e3f0efb0a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1725 microversion: 2.20 time: 0.151109 May 13 13:25:15.110852 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 132/274] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:14 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:15.424181 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6d668ce3-e385-4d68-8ab5-b9fc70a5c737 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:15.424791 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6d668ce3-e385-4d68-8ab5-b9fc70a5c737 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:15.430637 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6d668ce3-e385-4d68-8ab5-b9fc70a5c737 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:15.431077 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6d668ce3-e385-4d68-8ab5-b9fc70a5c737 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:15.431829 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6d668ce3-e385-4d68-8ab5-b9fc70a5c737 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:15.432254 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6d668ce3-e385-4d68-8ab5-b9fc70a5c737 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:15.565182 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6d668ce3-e385-4d68-8ab5-b9fc70a5c737 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:15.573440 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6d668ce3-e385-4d68-8ab5-b9fc70a5c737 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.154130 May 13 13:25:15.574160 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 143/275] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:15 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:15.929727 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-932c7508-671c-487a-9698-8ff55d17b841 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:15.930357 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-932c7508-671c-487a-9698-8ff55d17b841 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:15.936480 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-932c7508-671c-487a-9698-8ff55d17b841 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:15.936921 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-932c7508-671c-487a-9698-8ff55d17b841 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:15.937678 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-932c7508-671c-487a-9698-8ff55d17b841 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:15.938108 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-932c7508-671c-487a-9698-8ff55d17b841 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:16.069652 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-932c7508-671c-487a-9698-8ff55d17b841 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:16.077996 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-932c7508-671c-487a-9698-8ff55d17b841 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1509 microversion: 2.1 time: 0.152220 May 13 13:25:16.078607 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 133/276] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:15 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:16.129459 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7d1eab1c-32dc-4365-b1ad-45f77207c499 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:16.130062 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7d1eab1c-32dc-4365-b1ad-45f77207c499 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:16.136023 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7d1eab1c-32dc-4365-b1ad-45f77207c499 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:16.136495 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7d1eab1c-32dc-4365-b1ad-45f77207c499 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:16.137253 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7d1eab1c-32dc-4365-b1ad-45f77207c499 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:16.138927 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7d1eab1c-32dc-4365-b1ad-45f77207c499 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:16.271789 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7d1eab1c-32dc-4365-b1ad-45f77207c499 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:16.279775 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7d1eab1c-32dc-4365-b1ad-45f77207c499 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:16.281367 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7d1eab1c-32dc-4365-b1ad-45f77207c499 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:16.282578 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7d1eab1c-32dc-4365-b1ad-45f77207c499 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1725 microversion: 2.20 time: 0.156960 May 13 13:25:16.283779 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 144/277] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:16 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:16.590562 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a56efadd-9451-4add-8e29-14aa685a5c1f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:16.592416 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a56efadd-9451-4add-8e29-14aa685a5c1f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:16.598220 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a56efadd-9451-4add-8e29-14aa685a5c1f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:16.601264 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a56efadd-9451-4add-8e29-14aa685a5c1f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:16.601264 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a56efadd-9451-4add-8e29-14aa685a5c1f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:16.601264 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a56efadd-9451-4add-8e29-14aa685a5c1f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:16.732436 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a56efadd-9451-4add-8e29-14aa685a5c1f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:16.740243 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a56efadd-9451-4add-8e29-14aa685a5c1f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.153697 May 13 13:25:16.740799 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 134/278] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:16 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:17.095684 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-263884da-e6bf-4ffe-9cfb-0854f469ca88 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:17.096285 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-263884da-e6bf-4ffe-9cfb-0854f469ca88 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:17.103457 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-263884da-e6bf-4ffe-9cfb-0854f469ca88 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:17.112186 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-263884da-e6bf-4ffe-9cfb-0854f469ca88 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:17.112186 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-263884da-e6bf-4ffe-9cfb-0854f469ca88 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:17.112186 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-263884da-e6bf-4ffe-9cfb-0854f469ca88 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:17.241676 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-263884da-e6bf-4ffe-9cfb-0854f469ca88 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:17.249692 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-263884da-e6bf-4ffe-9cfb-0854f469ca88 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1509 microversion: 2.1 time: 0.158038 May 13 13:25:17.250297 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 145/279] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:17 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:17.302000 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-00418dea-5950-4070-980e-3065d85303eb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:17.302713 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-00418dea-5950-4070-980e-3065d85303eb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:17.309253 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-00418dea-5950-4070-980e-3065d85303eb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:17.310279 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-00418dea-5950-4070-980e-3065d85303eb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:17.311047 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-00418dea-5950-4070-980e-3065d85303eb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:17.311474 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-00418dea-5950-4070-980e-3065d85303eb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:17.448206 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-00418dea-5950-4070-980e-3065d85303eb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:17.456773 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-00418dea-5950-4070-980e-3065d85303eb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:17.458351 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-00418dea-5950-4070-980e-3065d85303eb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:17.459571 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-00418dea-5950-4070-980e-3065d85303eb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1725 microversion: 2.20 time: 0.161547 May 13 13:25:17.460138 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 135/280] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:17 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:17.757905 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-24afd756-54d8-45bd-bd96-bb4ed8b09143 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:17.758471 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-24afd756-54d8-45bd-bd96-bb4ed8b09143 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:17.765650 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-24afd756-54d8-45bd-bd96-bb4ed8b09143 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:17.766109 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-24afd756-54d8-45bd-bd96-bb4ed8b09143 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:17.766978 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-24afd756-54d8-45bd-bd96-bb4ed8b09143 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:17.767418 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-24afd756-54d8-45bd-bd96-bb4ed8b09143 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:17.899834 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-24afd756-54d8-45bd-bd96-bb4ed8b09143 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:17.908643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-24afd756-54d8-45bd-bd96-bb4ed8b09143 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.154525 May 13 13:25:17.909226 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 146/281] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:17 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:18.268431 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9903fda3-e4dd-49b5-aa8e-32e06a639a1f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:18.269337 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9903fda3-e4dd-49b5-aa8e-32e06a639a1f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:18.275367 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9903fda3-e4dd-49b5-aa8e-32e06a639a1f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:18.282359 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9903fda3-e4dd-49b5-aa8e-32e06a639a1f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:18.282359 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9903fda3-e4dd-49b5-aa8e-32e06a639a1f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:18.282359 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9903fda3-e4dd-49b5-aa8e-32e06a639a1f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:18.417203 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9903fda3-e4dd-49b5-aa8e-32e06a639a1f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:18.425734 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9903fda3-e4dd-49b5-aa8e-32e06a639a1f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1515 microversion: 2.1 time: 0.162488 May 13 13:25:18.426607 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 136/282] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:18 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:18.479057 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3ddefff2-d06c-4c94-84e6-6858e2536a63 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:18.480924 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3ddefff2-d06c-4c94-84e6-6858e2536a63 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:18.488996 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3ddefff2-d06c-4c94-84e6-6858e2536a63 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:18.488996 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3ddefff2-d06c-4c94-84e6-6858e2536a63 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:18.489641 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3ddefff2-d06c-4c94-84e6-6858e2536a63 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:18.490135 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3ddefff2-d06c-4c94-84e6-6858e2536a63 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:18.642507 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3ddefff2-d06c-4c94-84e6-6858e2536a63 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:18.650492 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3ddefff2-d06c-4c94-84e6-6858e2536a63 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:18.651985 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3ddefff2-d06c-4c94-84e6-6858e2536a63 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:18.653124 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3ddefff2-d06c-4c94-84e6-6858e2536a63 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1725 microversion: 2.20 time: 0.178269 May 13 13:25:18.654271 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 147/283] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:18 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:18.926002 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2a3807ec-38c4-439a-87d5-e162291f0150 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:18.927049 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2a3807ec-38c4-439a-87d5-e162291f0150 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:18.935104 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2a3807ec-38c4-439a-87d5-e162291f0150 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:18.935548 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2a3807ec-38c4-439a-87d5-e162291f0150 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:18.936337 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2a3807ec-38c4-439a-87d5-e162291f0150 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:18.936761 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2a3807ec-38c4-439a-87d5-e162291f0150 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:19.153969 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2a3807ec-38c4-439a-87d5-e162291f0150 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:19.158616 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2a3807ec-38c4-439a-87d5-e162291f0150 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.236807 May 13 13:25:19.159515 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 137/284] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:18 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:19.500988 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-74dd2c9c-a276-4690-97a3-6e4a3e2da792 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:19.501576 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-74dd2c9c-a276-4690-97a3-6e4a3e2da792 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 2184863b-7be8-470d-9369-12dd0297b6df] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:19.508369 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-74dd2c9c-a276-4690-97a3-6e4a3e2da792 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:19.508816 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-74dd2c9c-a276-4690-97a3-6e4a3e2da792 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:19.509584 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-74dd2c9c-a276-4690-97a3-6e4a3e2da792 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:19.510015 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-74dd2c9c-a276-4690-97a3-6e4a3e2da792 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:19.654727 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-74dd2c9c-a276-4690-97a3-6e4a3e2da792 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lazy-loading 'services' on Instance uuid 2184863b-7be8-470d-9369-12dd0297b6df {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:25:19.673753 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-901cce32-aab7-4b44-be31-57e9ae611bd5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:19.676653 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-901cce32-aab7-4b44-be31-57e9ae611bd5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:19.681051 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-901cce32-aab7-4b44-be31-57e9ae611bd5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:19.681628 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-901cce32-aab7-4b44-be31-57e9ae611bd5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:19.682859 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-901cce32-aab7-4b44-be31-57e9ae611bd5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:19.683353 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-901cce32-aab7-4b44-be31-57e9ae611bd5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:19.838488 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-901cce32-aab7-4b44-be31-57e9ae611bd5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:19.848006 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-901cce32-aab7-4b44-be31-57e9ae611bd5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:19.849931 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-901cce32-aab7-4b44-be31-57e9ae611bd5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:19.851150 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-901cce32-aab7-4b44-be31-57e9ae611bd5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1725 microversion: 2.20 time: 0.182542 May 13 13:25:19.851714 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 138/285] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:19 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:20.071530 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-74dd2c9c-a276-4690-97a3-6e4a3e2da792 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df/os-volume_attachments/522527c4-721a-4c9b-89da-79770b08cc9a" status: 202 len: 0 microversion: 2.1 time: 0.574341 May 13 13:25:20.072240 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 148/286] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 13 13:25:19 2022] DELETE /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df/os-volume_attachments/522527c4-721a-4c9b-89da-79770b08cc9a => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 13:25:20.177568 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9b2d7e26-8337-4fc5-aa3e-bf1dae66883b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:20.178368 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9b2d7e26-8337-4fc5-aa3e-bf1dae66883b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:20.186101 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9b2d7e26-8337-4fc5-aa3e-bf1dae66883b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:20.186914 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9b2d7e26-8337-4fc5-aa3e-bf1dae66883b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:20.194359 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9b2d7e26-8337-4fc5-aa3e-bf1dae66883b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:20.194359 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9b2d7e26-8337-4fc5-aa3e-bf1dae66883b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:20.330928 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9b2d7e26-8337-4fc5-aa3e-bf1dae66883b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:20.346184 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9b2d7e26-8337-4fc5-aa3e-bf1dae66883b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.173938 May 13 13:25:20.346808 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 139/287] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:20 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:20.871398 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0f1f23c1-cd3c-4893-a447-382a88394b35 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:20.872219 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0f1f23c1-cd3c-4893-a447-382a88394b35 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:20.878616 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0f1f23c1-cd3c-4893-a447-382a88394b35 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:20.879072 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0f1f23c1-cd3c-4893-a447-382a88394b35 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:20.879845 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0f1f23c1-cd3c-4893-a447-382a88394b35 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:20.880279 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0f1f23c1-cd3c-4893-a447-382a88394b35 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:21.016062 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0f1f23c1-cd3c-4893-a447-382a88394b35 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:21.024523 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0f1f23c1-cd3c-4893-a447-382a88394b35 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:21.026020 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0f1f23c1-cd3c-4893-a447-382a88394b35 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:21.027199 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0f1f23c1-cd3c-4893-a447-382a88394b35 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1725 microversion: 2.20 time: 0.160845 May 13 13:25:21.027755 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 149/288] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:20 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:21.365202 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d759443b-483c-43c0-bf37-e494a1adb33f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:21.366067 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d759443b-483c-43c0-bf37-e494a1adb33f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:21.373642 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d759443b-483c-43c0-bf37-e494a1adb33f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:21.374042 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d759443b-483c-43c0-bf37-e494a1adb33f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:21.375297 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d759443b-483c-43c0-bf37-e494a1adb33f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:21.375297 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d759443b-483c-43c0-bf37-e494a1adb33f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:21.523913 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d759443b-483c-43c0-bf37-e494a1adb33f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:21.535404 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d759443b-483c-43c0-bf37-e494a1adb33f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.175080 May 13 13:25:21.536204 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 140/289] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:21 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:22.048101 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1a40c811-3096-4a04-8210-2c531977a79f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:22.049107 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1a40c811-3096-4a04-8210-2c531977a79f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:22.058128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1a40c811-3096-4a04-8210-2c531977a79f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:22.058873 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1a40c811-3096-4a04-8210-2c531977a79f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:22.060916 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1a40c811-3096-4a04-8210-2c531977a79f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:22.061643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1a40c811-3096-4a04-8210-2c531977a79f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:22.210097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1a40c811-3096-4a04-8210-2c531977a79f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:22.220261 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1a40c811-3096-4a04-8210-2c531977a79f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:22.222463 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1a40c811-3096-4a04-8210-2c531977a79f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:22.223288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1a40c811-3096-4a04-8210-2c531977a79f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1725 microversion: 2.20 time: 0.180371 May 13 13:25:22.224213 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 150/290] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:22 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:22.552730 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f4c0934f-5e6d-47da-b21b-4ca32c3618ba tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:22.553331 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f4c0934f-5e6d-47da-b21b-4ca32c3618ba tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:22.560606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f4c0934f-5e6d-47da-b21b-4ca32c3618ba tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:22.568846 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f4c0934f-5e6d-47da-b21b-4ca32c3618ba tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:22.568846 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f4c0934f-5e6d-47da-b21b-4ca32c3618ba tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:22.568846 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f4c0934f-5e6d-47da-b21b-4ca32c3618ba tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:22.688389 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f4c0934f-5e6d-47da-b21b-4ca32c3618ba tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:22.696417 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f4c0934f-5e6d-47da-b21b-4ca32c3618ba tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.147422 May 13 13:25:22.696986 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 141/291] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:22 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:23.242976 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-67ce31f6-315f-4a7d-94d1-dcff9c01607e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:23.247434 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-67ce31f6-315f-4a7d-94d1-dcff9c01607e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:23.249948 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-67ce31f6-315f-4a7d-94d1-dcff9c01607e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:23.250439 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-67ce31f6-315f-4a7d-94d1-dcff9c01607e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:23.251204 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-67ce31f6-315f-4a7d-94d1-dcff9c01607e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:23.251694 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-67ce31f6-315f-4a7d-94d1-dcff9c01607e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:23.393943 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-67ce31f6-315f-4a7d-94d1-dcff9c01607e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:23.401646 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-67ce31f6-315f-4a7d-94d1-dcff9c01607e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:23.403191 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-67ce31f6-315f-4a7d-94d1-dcff9c01607e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:23.404498 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-67ce31f6-315f-4a7d-94d1-dcff9c01607e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1746 microversion: 2.20 time: 0.165439 May 13 13:25:23.405078 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 151/292] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:23 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1746 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:23.685009 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b7a7405a-b90f-4dda-ac7f-e879213c49f1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Action: 'create', calling method: .version_select at 0x7fb084360b80>, body: {"keypair": {"name": "tempest-keypair-325993084", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHynKQc3DK4ICO6OjT7PHd6SCcX5FD2s3DTT+wfSm/Qf5Zf/4aCVf5R5OpYdn6DdK3x3PTmqgFsR2AjvkOZ97cXVZYy0AJmAgfE3xr74nOrZGajvFirpJeykQRbgQxwaOw=="}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:23.699474 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-b7a7405a-b90f-4dda-ac7f-e879213c49f1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Getting quotas for project a0e165a1f0d34fca81de45a48c6cdbb9. Resources: {'key_pairs'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:25:23.703365 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-b7a7405a-b90f-4dda-ac7f-e879213c49f1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Getting quotas for user 805e8e6c39f94d3bbcf60930492e297c and project a0e165a1f0d34fca81de45a48c6cdbb9. Resources: {'key_pairs'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:25:23.714570 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-675f594f-f950-490f-9ccb-e603ffd00e23 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:23.715245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-675f594f-f950-490f-9ccb-e603ffd00e23 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:23.721688 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-675f594f-f950-490f-9ccb-e603ffd00e23 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:23.722137 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-675f594f-f950-490f-9ccb-e603ffd00e23 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:23.723005 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-675f594f-f950-490f-9ccb-e603ffd00e23 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:23.723434 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-675f594f-f950-490f-9ccb-e603ffd00e23 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:23.830427 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b7a7405a-b90f-4dda-ac7f-e879213c49f1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.149035 May 13 13:25:23.830915 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 142/293] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 13 13:25:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:25:23.870406 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-675f594f-f950-490f-9ccb-e603ffd00e23 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:23.878991 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-675f594f-f950-490f-9ccb-e603ffd00e23 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.168767 May 13 13:25:23.893651 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 152/294] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:23 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:24.423802 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-89033599-c7da-4758-a4c8-526cddeb1184 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:24.424412 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-89033599-c7da-4758-a4c8-526cddeb1184 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:24.430739 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-89033599-c7da-4758-a4c8-526cddeb1184 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:24.431187 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-89033599-c7da-4758-a4c8-526cddeb1184 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:24.431965 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-89033599-c7da-4758-a4c8-526cddeb1184 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:24.432402 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-89033599-c7da-4758-a4c8-526cddeb1184 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:24.581002 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-89033599-c7da-4758-a4c8-526cddeb1184 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:24.589234 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-89033599-c7da-4758-a4c8-526cddeb1184 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:24.590878 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-89033599-c7da-4758-a4c8-526cddeb1184 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:24.592033 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-89033599-c7da-4758-a4c8-526cddeb1184 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1746 microversion: 2.20 time: 0.172327 May 13 13:25:24.592602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 143/295] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:24 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1746 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:24.910151 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7b39be02-910f-45d3-8b6e-e3f5418c6332 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:24.911119 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7b39be02-910f-45d3-8b6e-e3f5418c6332 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:24.917353 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7b39be02-910f-45d3-8b6e-e3f5418c6332 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:24.917800 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7b39be02-910f-45d3-8b6e-e3f5418c6332 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:24.918593 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7b39be02-910f-45d3-8b6e-e3f5418c6332 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:24.919714 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7b39be02-910f-45d3-8b6e-e3f5418c6332 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:25.072036 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7b39be02-910f-45d3-8b6e-e3f5418c6332 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:25.081603 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7b39be02-910f-45d3-8b6e-e3f5418c6332 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.175189 May 13 13:25:25.082602 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 153/296] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:24 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:25.440372 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-282463fd-955d-4c91-a260-cd822384f3e1 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:25.441061 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-282463fd-955d-4c91-a260-cd822384f3e1 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 2184863b-7be8-470d-9369-12dd0297b6df] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:25.448189 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-282463fd-955d-4c91-a260-cd822384f3e1 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:25.448903 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-282463fd-955d-4c91-a260-cd822384f3e1 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:25.449865 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-282463fd-955d-4c91-a260-cd822384f3e1 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:25.450446 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-282463fd-955d-4c91-a260-cd822384f3e1 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:25.482159 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-282463fd-955d-4c91-a260-cd822384f3e1 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 2184863b-7be8-470d-9369-12dd0297b6df] Going to try to terminate instance {{(pid=117720) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:25:25.612772 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ee23a5fc-0661-4f01-aa24-5d5aac352c49 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:25.614309 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ee23a5fc-0661-4f01-aa24-5d5aac352c49 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:25.623573 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ee23a5fc-0661-4f01-aa24-5d5aac352c49 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:25.624025 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ee23a5fc-0661-4f01-aa24-5d5aac352c49 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:25.624811 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ee23a5fc-0661-4f01-aa24-5d5aac352c49 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:25.625246 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ee23a5fc-0661-4f01-aa24-5d5aac352c49 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:25.804069 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ee23a5fc-0661-4f01-aa24-5d5aac352c49 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:25.812906 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ee23a5fc-0661-4f01-aa24-5d5aac352c49 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:25.814665 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ee23a5fc-0661-4f01-aa24-5d5aac352c49 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:25.815529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ee23a5fc-0661-4f01-aa24-5d5aac352c49 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1746 microversion: 2.20 time: 0.209185 May 13 13:25:25.816087 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 154/297] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:25 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1746 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:25.862063 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-282463fd-955d-4c91-a260-cd822384f3e1 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df" status: 204 len: 0 microversion: 2.1 time: 0.425398 May 13 13:25:25.862695 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 144/298] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:25:25 2022] DELETE /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:25:25.877304 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-29552525-7118-4796-8bad-6f84b2911546 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:25.877746 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-29552525-7118-4796-8bad-6f84b2911546 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 2184863b-7be8-470d-9369-12dd0297b6df] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:25.889434 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-29552525-7118-4796-8bad-6f84b2911546 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:25.890323 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-29552525-7118-4796-8bad-6f84b2911546 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:25.891920 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-29552525-7118-4796-8bad-6f84b2911546 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:25.892959 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-29552525-7118-4796-8bad-6f84b2911546 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:26.073210 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-29552525-7118-4796-8bad-6f84b2911546 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:26.082141 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-29552525-7118-4796-8bad-6f84b2911546 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df" status: 200 len: 1511 microversion: 2.1 time: 0.213018 May 13 13:25:26.082768 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 155/299] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:25 2022] GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df => generated 1511 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:26.105267 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5bd1508f-32d1-4215-9561-c8a5b31fbf5e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:26.105966 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5bd1508f-32d1-4215-9561-c8a5b31fbf5e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:26.112456 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5bd1508f-32d1-4215-9561-c8a5b31fbf5e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:26.112875 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5bd1508f-32d1-4215-9561-c8a5b31fbf5e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:26.113663 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5bd1508f-32d1-4215-9561-c8a5b31fbf5e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:26.114091 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5bd1508f-32d1-4215-9561-c8a5b31fbf5e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:26.261687 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5bd1508f-32d1-4215-9561-c8a5b31fbf5e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:26.271990 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5bd1508f-32d1-4215-9561-c8a5b31fbf5e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.170826 May 13 13:25:26.272664 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 145/300] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:26 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:26.688087 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6711eaff-b347-4ab7-99b7-484a7953565a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1326959503", "imageRef": "ece294e8-5415-4d6a-a0d3-a14539c51c0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "12caf126-4974-46b6-8013-584333b351af"}], "security_groups": [{"name": "tempest-securitygroup--533922975"}], "key_name": "tempest-keypair-325993084", "user_data": "}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:26.792405 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.network.neutron [None req-6711eaff-b347-4ab7-99b7-484a7953565a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] validate_networks() for [('12caf126-4974-46b6-8013-584333b351af', None, None, None, None, None)] {{(pid=117721) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:25:26.835048 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3b52eb11-7810-43f2-beb1-cafb3f067565 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:26.835649 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3b52eb11-7810-43f2-beb1-cafb3f067565 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:26.843540 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3b52eb11-7810-43f2-beb1-cafb3f067565 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:26.844206 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3b52eb11-7810-43f2-beb1-cafb3f067565 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:26.845275 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3b52eb11-7810-43f2-beb1-cafb3f067565 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:26.845969 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3b52eb11-7810-43f2-beb1-cafb3f067565 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:27.041688 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3b52eb11-7810-43f2-beb1-cafb3f067565 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:27.051425 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3b52eb11-7810-43f2-beb1-cafb3f067565 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:27.053113 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3b52eb11-7810-43f2-beb1-cafb3f067565 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:27.054305 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3b52eb11-7810-43f2-beb1-cafb3f067565 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1746 microversion: 2.20 time: 0.223120 May 13 13:25:27.054953 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 146/301] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:26 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1746 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:25:27.103989 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e663ee23-6160-4b29-83a3-e19efecc1e7a tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:27.104587 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e663ee23-6160-4b29-83a3-e19efecc1e7a tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 2184863b-7be8-470d-9369-12dd0297b6df] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:27.111200 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e663ee23-6160-4b29-83a3-e19efecc1e7a tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:27.111639 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e663ee23-6160-4b29-83a3-e19efecc1e7a tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:27.112402 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e663ee23-6160-4b29-83a3-e19efecc1e7a tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:27.112829 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e663ee23-6160-4b29-83a3-e19efecc1e7a tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:27.321454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-6711eaff-b347-4ab7-99b7-484a7953565a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Flavor limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:25:27.321942 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-6711eaff-b347-4ab7-99b7-484a7953565a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Image limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:25:27.322378 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-6711eaff-b347-4ab7-99b7-484a7953565a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Flavor pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:25:27.322795 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-6711eaff-b347-4ab7-99b7-484a7953565a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Image pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:25:27.323207 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-6711eaff-b347-4ab7-99b7-484a7953565a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:25:27.325368 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e663ee23-6160-4b29-83a3-e19efecc1e7a tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:27.332616 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6711eaff-b347-4ab7-99b7-484a7953565a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:27.333056 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6711eaff-b347-4ab7-99b7-484a7953565a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:27.333853 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6711eaff-b347-4ab7-99b7-484a7953565a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:27.334049 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e663ee23-6160-4b29-83a3-e19efecc1e7a tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df" status: 200 len: 1511 microversion: 2.1 time: 0.233584 May 13 13:25:27.334483 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6711eaff-b347-4ab7-99b7-484a7953565a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:27.334782 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 147/302] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:27 2022] GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df => generated 1511 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:27.349294 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e0fa31bb-8fc9-48b0-9715-ee37a707050e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:27.349898 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e0fa31bb-8fc9-48b0-9715-ee37a707050e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:27.353506 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-6711eaff-b347-4ab7-99b7-484a7953565a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Getting quotas for project a0e165a1f0d34fca81de45a48c6cdbb9. Resources: {'cores', 'instances', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:25:27.355860 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e0fa31bb-8fc9-48b0-9715-ee37a707050e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:27.357065 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e0fa31bb-8fc9-48b0-9715-ee37a707050e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:27.357796 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e0fa31bb-8fc9-48b0-9715-ee37a707050e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:27.358188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-6711eaff-b347-4ab7-99b7-484a7953565a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Getting quotas for user 805e8e6c39f94d3bbcf60930492e297c and project a0e165a1f0d34fca81de45a48c6cdbb9. Resources: {'cores', 'instances', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:25:27.358310 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e0fa31bb-8fc9-48b0-9715-ee37a707050e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:27.371080 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6711eaff-b347-4ab7-99b7-484a7953565a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Going to run 1 instances... {{(pid=117721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:25:27.374057 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6711eaff-b347-4ab7-99b7-484a7953565a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ece294e8-5415-4d6a-a0d3-a14539c51c0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:25:27.499688 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e0fa31bb-8fc9-48b0-9715-ee37a707050e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:27.508293 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e0fa31bb-8fc9-48b0-9715-ee37a707050e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.162710 May 13 13:25:27.509065 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 148/303] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:27 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:27.510587 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6711eaff-b347-4ab7-99b7-484a7953565a tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.827456 May 13 13:25:27.511222 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 156/304] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 13 13:25:26 2022] POST /compute/v2.1/servers => generated 408 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:25:27.523599 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2a02c48a-42b5-4f4e-8a91-cacbc97d0afb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:27.524210 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2a02c48a-42b5-4f4e-8a91-cacbc97d0afb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:27.584416 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2a02c48a-42b5-4f4e-8a91-cacbc97d0afb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:27.585187 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2a02c48a-42b5-4f4e-8a91-cacbc97d0afb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1245 microversion: 2.1 time: 0.065587 May 13 13:25:27.585979 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 149/305] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:27 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1245 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:28.073039 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8ca8a6af-3832-4d31-8d45-b6698b6f6c46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:28.073738 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8ca8a6af-3832-4d31-8d45-b6698b6f6c46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:28.081921 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8ca8a6af-3832-4d31-8d45-b6698b6f6c46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:28.082505 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8ca8a6af-3832-4d31-8d45-b6698b6f6c46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:28.087557 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8ca8a6af-3832-4d31-8d45-b6698b6f6c46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:28.087557 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8ca8a6af-3832-4d31-8d45-b6698b6f6c46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:28.217081 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8ca8a6af-3832-4d31-8d45-b6698b6f6c46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:28.225463 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8ca8a6af-3832-4d31-8d45-b6698b6f6c46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:28.227022 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8ca8a6af-3832-4d31-8d45-b6698b6f6c46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:28.228176 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8ca8a6af-3832-4d31-8d45-b6698b6f6c46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1746 microversion: 2.20 time: 0.159087 May 13 13:25:28.228733 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 157/306] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:28 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:28.352556 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f76ef17d-05a2-490e-b79b-21b1fb675213 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:28.353213 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f76ef17d-05a2-490e-b79b-21b1fb675213 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 2184863b-7be8-470d-9369-12dd0297b6df] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:28.360430 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f76ef17d-05a2-490e-b79b-21b1fb675213 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:28.360995 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f76ef17d-05a2-490e-b79b-21b1fb675213 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:28.361677 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f76ef17d-05a2-490e-b79b-21b1fb675213 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:28.362179 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f76ef17d-05a2-490e-b79b-21b1fb675213 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:28.532010 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-dd589ca1-7d97-45b9-8faa-3588c7050038 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:28.532010 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-dd589ca1-7d97-45b9-8faa-3588c7050038 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:28.537874 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dd589ca1-7d97-45b9-8faa-3588c7050038 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:28.538347 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dd589ca1-7d97-45b9-8faa-3588c7050038 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:28.539117 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dd589ca1-7d97-45b9-8faa-3588c7050038 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:28.539542 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dd589ca1-7d97-45b9-8faa-3588c7050038 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:28.768280 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f76ef17d-05a2-490e-b79b-21b1fb675213 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:28.775857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f76ef17d-05a2-490e-b79b-21b1fb675213 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df" status: 200 len: 1511 microversion: 2.1 time: 0.427490 May 13 13:25:28.776682 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 150/307] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:28 2022] GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df => generated 1511 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:28.779762 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-dd589ca1-7d97-45b9-8faa-3588c7050038 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:28.782464 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-34605158-e277-46b4-9b1e-303355e74adc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:28.783126 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-34605158-e277-46b4-9b1e-303355e74adc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:28.789431 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34605158-e277-46b4-9b1e-303355e74adc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:28.790506 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34605158-e277-46b4-9b1e-303355e74adc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:28.790971 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34605158-e277-46b4-9b1e-303355e74adc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:28.791401 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34605158-e277-46b4-9b1e-303355e74adc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:28.792588 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-dd589ca1-7d97-45b9-8faa-3588c7050038 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.266122 May 13 13:25:28.793176 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 158/308] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:28 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:28.859278 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-34605158-e277-46b4-9b1e-303355e74adc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:28.867198 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-34605158-e277-46b4-9b1e-303355e74adc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1249 microversion: 2.1 time: 0.089149 May 13 13:25:28.867775 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 151/309] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:28 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1249 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:29.053743 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-62f75b8b-cc9d-4056-83a9-958e1a60004a req-ef649b0b-acae-4e78-8fe8-c8cb43c181cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6", "name": "network-vif-plugged", "status": "completed", "tag": "c523458e-8e82-46df-bfae-db11fc8b2ec5"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:29.063103 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-62f75b8b-cc9d-4056-83a9-958e1a60004a req-ef649b0b-acae-4e78-8fe8-c8cb43c181cf service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:29.063579 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-62f75b8b-cc9d-4056-83a9-958e1a60004a req-ef649b0b-acae-4e78-8fe8-c8cb43c181cf service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:29.076877 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-62f75b8b-cc9d-4056-83a9-958e1a60004a req-ef649b0b-acae-4e78-8fe8-c8cb43c181cf service nova] Creating event network-vif-plugged:c523458e-8e82-46df-bfae-db11fc8b2ec5 for instance 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 on hv-cinder-84163 May 13 13:25:29.081978 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-62f75b8b-cc9d-4056-83a9-958e1a60004a req-ef649b0b-acae-4e78-8fe8-c8cb43c181cf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031842 May 13 13:25:29.082655 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 159/310] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:25:29.246911 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4a1a24c2-e2c5-4115-9771-21b1605d67b9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:29.248112 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4a1a24c2-e2c5-4115-9771-21b1605d67b9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:29.254375 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4a1a24c2-e2c5-4115-9771-21b1605d67b9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:29.254887 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4a1a24c2-e2c5-4115-9771-21b1605d67b9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:29.255652 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4a1a24c2-e2c5-4115-9771-21b1605d67b9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:29.256086 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4a1a24c2-e2c5-4115-9771-21b1605d67b9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:29.391362 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4a1a24c2-e2c5-4115-9771-21b1605d67b9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:29.399679 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4a1a24c2-e2c5-4115-9771-21b1605d67b9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:29.401253 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4a1a24c2-e2c5-4115-9771-21b1605d67b9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:29.402573 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4a1a24c2-e2c5-4115-9771-21b1605d67b9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1746 microversion: 2.20 time: 0.159537 May 13 13:25:29.403205 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 152/311] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:29 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:29.795124 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d27e58d3-c9c7-4223-8a6f-930f8fa0e6c0 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:29.795733 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d27e58d3-c9c7-4223-8a6f-930f8fa0e6c0 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 2184863b-7be8-470d-9369-12dd0297b6df] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:29.802528 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d27e58d3-c9c7-4223-8a6f-930f8fa0e6c0 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:29.802973 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d27e58d3-c9c7-4223-8a6f-930f8fa0e6c0 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:29.803746 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d27e58d3-c9c7-4223-8a6f-930f8fa0e6c0 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:29.804244 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d27e58d3-c9c7-4223-8a6f-930f8fa0e6c0 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:29.812012 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c3f74c4a-988b-4d83-9baa-5832c16add7f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:29.812616 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c3f74c4a-988b-4d83-9baa-5832c16add7f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:29.818645 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c3f74c4a-988b-4d83-9baa-5832c16add7f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:29.819122 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c3f74c4a-988b-4d83-9baa-5832c16add7f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:29.819908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c3f74c4a-988b-4d83-9baa-5832c16add7f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:29.820351 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c3f74c4a-988b-4d83-9baa-5832c16add7f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:30.008146 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d27e58d3-c9c7-4223-8a6f-930f8fa0e6c0 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:30.015613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d27e58d3-c9c7-4223-8a6f-930f8fa0e6c0 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df" status: 200 len: 1511 microversion: 2.1 time: 0.225389 May 13 13:25:30.016347 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 160/312] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:29 2022] GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df => generated 1511 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:30.019888 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c3f74c4a-988b-4d83-9baa-5832c16add7f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:30.025134 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-977c8593-81a9-4ce6-837f-a649130788f1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:30.025740 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-977c8593-81a9-4ce6-837f-a649130788f1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:30.027988 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c3f74c4a-988b-4d83-9baa-5832c16add7f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.220435 May 13 13:25:30.028799 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 153/313] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:29 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:30.033744 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-977c8593-81a9-4ce6-837f-a649130788f1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:30.045609 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-977c8593-81a9-4ce6-837f-a649130788f1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:30.045609 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-977c8593-81a9-4ce6-837f-a649130788f1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:30.045609 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-977c8593-81a9-4ce6-837f-a649130788f1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:30.100141 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-977c8593-81a9-4ce6-837f-a649130788f1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:30.108454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-977c8593-81a9-4ce6-837f-a649130788f1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1249 microversion: 2.1 time: 0.086937 May 13 13:25:30.109021 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 161/314] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:30 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:30.421612 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5f1ed9d0-4677-441c-9fd2-cc30f57c5918 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:30.422235 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5f1ed9d0-4677-441c-9fd2-cc30f57c5918 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:30.429035 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5f1ed9d0-4677-441c-9fd2-cc30f57c5918 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:30.429480 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5f1ed9d0-4677-441c-9fd2-cc30f57c5918 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:30.430280 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5f1ed9d0-4677-441c-9fd2-cc30f57c5918 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:30.430717 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5f1ed9d0-4677-441c-9fd2-cc30f57c5918 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:30.572541 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5f1ed9d0-4677-441c-9fd2-cc30f57c5918 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:30.582982 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5f1ed9d0-4677-441c-9fd2-cc30f57c5918 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:30.584494 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5f1ed9d0-4677-441c-9fd2-cc30f57c5918 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:30.585711 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5f1ed9d0-4677-441c-9fd2-cc30f57c5918 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1746 microversion: 2.20 time: 0.168063 May 13 13:25:30.586733 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 154/315] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:30 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:31.043149 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4b569af5-9972-470d-aa75-74fb6844260b tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:31.043149 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4b569af5-9972-470d-aa75-74fb6844260b tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 2184863b-7be8-470d-9369-12dd0297b6df] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:31.043149 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4b569af5-9972-470d-aa75-74fb6844260b tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:31.043149 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4b569af5-9972-470d-aa75-74fb6844260b tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:31.044023 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4b569af5-9972-470d-aa75-74fb6844260b tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:31.044023 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4b569af5-9972-470d-aa75-74fb6844260b tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:31.052998 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f1d5d811-9d1b-44c0-b438-fe3911d22523 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:31.053840 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f1d5d811-9d1b-44c0-b438-fe3911d22523 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:31.064491 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f1d5d811-9d1b-44c0-b438-fe3911d22523 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:31.067074 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f1d5d811-9d1b-44c0-b438-fe3911d22523 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:31.067925 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f1d5d811-9d1b-44c0-b438-fe3911d22523 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:31.068372 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f1d5d811-9d1b-44c0-b438-fe3911d22523 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:31.276745 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4b569af5-9972-470d-aa75-74fb6844260b tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:31.285602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f1d5d811-9d1b-44c0-b438-fe3911d22523 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:31.289376 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4b569af5-9972-470d-aa75-74fb6844260b tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df" status: 200 len: 1511 microversion: 2.1 time: 0.259501 May 13 13:25:31.290146 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 162/316] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:31 2022] GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df => generated 1511 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:31.294585 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f1d5d811-9d1b-44c0-b438-fe3911d22523 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.245265 May 13 13:25:31.296656 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cf056f03-bb1e-4ebb-804c-d4618754a7e1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:31.297425 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-cf056f03-bb1e-4ebb-804c-d4618754a7e1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:31.304459 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 155/317] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:31 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:31.305595 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cf056f03-bb1e-4ebb-804c-d4618754a7e1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:31.306133 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cf056f03-bb1e-4ebb-804c-d4618754a7e1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:31.307040 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cf056f03-bb1e-4ebb-804c-d4618754a7e1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:31.307538 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cf056f03-bb1e-4ebb-804c-d4618754a7e1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:31.386111 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-cf056f03-bb1e-4ebb-804c-d4618754a7e1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:31.398050 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-cf056f03-bb1e-4ebb-804c-d4618754a7e1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1297 microversion: 2.1 time: 0.106658 May 13 13:25:31.399620 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 163/318] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:31 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1297 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:31.479270 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-f6c0d42c-6ae3-4cb5-8b63-9e712aad78d9 req-3391a9ae-edb3-4ad3-b91f-3a67b7cbdd53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2184863b-7be8-470d-9369-12dd0297b6df", "name": "network-vif-deleted", "tag": "f582d3bf-ec6f-40d5-9a9f-73169c7b67cb"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:31.489473 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-f6c0d42c-6ae3-4cb5-8b63-9e712aad78d9 req-3391a9ae-edb3-4ad3-b91f-3a67b7cbdd53 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:31.489602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-f6c0d42c-6ae3-4cb5-8b63-9e712aad78d9 req-3391a9ae-edb3-4ad3-b91f-3a67b7cbdd53 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:31.503651 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-f6c0d42c-6ae3-4cb5-8b63-9e712aad78d9 req-3391a9ae-edb3-4ad3-b91f-3a67b7cbdd53 service nova] Creating event network-vif-deleted:f582d3bf-ec6f-40d5-9a9f-73169c7b67cb for instance 2184863b-7be8-470d-9369-12dd0297b6df on hv-cinder-84163 May 13 13:25:31.506524 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-f6c0d42c-6ae3-4cb5-8b63-9e712aad78d9 req-3391a9ae-edb3-4ad3-b91f-3a67b7cbdd53 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032003 May 13 13:25:31.507131 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 156/319] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:25:31.607264 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-986fd9a4-d030-44b2-87fc-51b19f48a720 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:31.607957 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-986fd9a4-d030-44b2-87fc-51b19f48a720 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:31.614432 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-986fd9a4-d030-44b2-87fc-51b19f48a720 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:31.614805 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-986fd9a4-d030-44b2-87fc-51b19f48a720 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:31.615576 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-986fd9a4-d030-44b2-87fc-51b19f48a720 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:31.616005 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-986fd9a4-d030-44b2-87fc-51b19f48a720 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:31.756479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-986fd9a4-d030-44b2-87fc-51b19f48a720 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:31.765319 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-986fd9a4-d030-44b2-87fc-51b19f48a720 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:31.766991 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-986fd9a4-d030-44b2-87fc-51b19f48a720 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:31.768508 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-986fd9a4-d030-44b2-87fc-51b19f48a720 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1741 microversion: 2.20 time: 0.166469 May 13 13:25:31.769294 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 164/320] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:31 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1741 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:32.307152 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9963c4e7-d96d-47a5-9d33-49c6a09933ac tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:32.308096 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9963c4e7-d96d-47a5-9d33-49c6a09933ac tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 2184863b-7be8-470d-9369-12dd0297b6df] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:32.313809 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ddf3a036-4120-45e6-84d9-79a15bad6e66 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:32.316388 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9963c4e7-d96d-47a5-9d33-49c6a09933ac tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:32.316388 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9963c4e7-d96d-47a5-9d33-49c6a09933ac tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:32.319531 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9963c4e7-d96d-47a5-9d33-49c6a09933ac tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:32.319531 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9963c4e7-d96d-47a5-9d33-49c6a09933ac tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:32.319732 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ddf3a036-4120-45e6-84d9-79a15bad6e66 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:32.326420 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ddf3a036-4120-45e6-84d9-79a15bad6e66 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:32.327110 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ddf3a036-4120-45e6-84d9-79a15bad6e66 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:32.328286 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ddf3a036-4120-45e6-84d9-79a15bad6e66 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:32.328871 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ddf3a036-4120-45e6-84d9-79a15bad6e66 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:32.395631 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9963c4e7-d96d-47a5-9d33-49c6a09933ac tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:32.404495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9963c4e7-d96d-47a5-9d33-49c6a09933ac tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df" status: 200 len: 1304 microversion: 2.1 time: 0.101369 May 13 13:25:32.415746 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 157/321] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:32 2022] GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:32.423814 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-cc3d010b-e6d8-4205-b1b6-671107fb6f6e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:32.423814 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-cc3d010b-e6d8-4205-b1b6-671107fb6f6e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:32.429320 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cc3d010b-e6d8-4205-b1b6-671107fb6f6e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:32.436438 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cc3d010b-e6d8-4205-b1b6-671107fb6f6e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:32.436438 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cc3d010b-e6d8-4205-b1b6-671107fb6f6e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:32.436438 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cc3d010b-e6d8-4205-b1b6-671107fb6f6e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:32.526848 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-cc3d010b-e6d8-4205-b1b6-671107fb6f6e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:32.538978 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-cc3d010b-e6d8-4205-b1b6-671107fb6f6e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1297 microversion: 2.1 time: 0.122060 May 13 13:25:32.539726 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 158/322] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:32 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1297 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:32.587606 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ddf3a036-4120-45e6-84d9-79a15bad6e66 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:32.598099 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ddf3a036-4120-45e6-84d9-79a15bad6e66 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.290295 May 13 13:25:32.609634 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 165/323] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:32 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:32.978320 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-984942ab-145f-4771-8fb9-98b5b6bfe7c4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:32.978320 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-984942ab-145f-4771-8fb9-98b5b6bfe7c4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:32.978320 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-984942ab-145f-4771-8fb9-98b5b6bfe7c4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:32.978320 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-984942ab-145f-4771-8fb9-98b5b6bfe7c4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:32.978963 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-984942ab-145f-4771-8fb9-98b5b6bfe7c4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:32.978963 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-984942ab-145f-4771-8fb9-98b5b6bfe7c4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:33.026488 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-984942ab-145f-4771-8fb9-98b5b6bfe7c4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:33.049309 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-984942ab-145f-4771-8fb9-98b5b6bfe7c4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:33.053485 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-984942ab-145f-4771-8fb9-98b5b6bfe7c4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:33.055286 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-984942ab-145f-4771-8fb9-98b5b6bfe7c4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1741 microversion: 2.20 time: 0.261339 May 13 13:25:33.063929 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 159/324] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:32 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1741 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:33.424087 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-aa2dafd6-8531-4b3e-8f04-ca65177c9665 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:33.425463 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-aa2dafd6-8531-4b3e-8f04-ca65177c9665 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 2184863b-7be8-470d-9369-12dd0297b6df] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:33.432517 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aa2dafd6-8531-4b3e-8f04-ca65177c9665 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:33.432961 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aa2dafd6-8531-4b3e-8f04-ca65177c9665 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:33.433731 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aa2dafd6-8531-4b3e-8f04-ca65177c9665 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:33.434526 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aa2dafd6-8531-4b3e-8f04-ca65177c9665 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:33.520940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-aa2dafd6-8531-4b3e-8f04-ca65177c9665 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:33.536644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-aa2dafd6-8531-4b3e-8f04-ca65177c9665 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df" status: 200 len: 1304 microversion: 2.1 time: 0.117303 May 13 13:25:33.552605 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 166/325] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:33 2022] GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df => generated 1304 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:33.557728 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2bd238b2-3579-484e-9ff0-d0d9aee6e62f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:33.558843 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2bd238b2-3579-484e-9ff0-d0d9aee6e62f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:33.567657 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2bd238b2-3579-484e-9ff0-d0d9aee6e62f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:33.569231 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2bd238b2-3579-484e-9ff0-d0d9aee6e62f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:33.570298 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2bd238b2-3579-484e-9ff0-d0d9aee6e62f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:33.570895 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2bd238b2-3579-484e-9ff0-d0d9aee6e62f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:33.619653 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-84bb2877-b8fa-48a6-9116-a874b99a393f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:33.620254 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-84bb2877-b8fa-48a6-9116-a874b99a393f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:33.627451 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-84bb2877-b8fa-48a6-9116-a874b99a393f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:33.628135 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-84bb2877-b8fa-48a6-9116-a874b99a393f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:33.629305 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-84bb2877-b8fa-48a6-9116-a874b99a393f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:33.630314 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-84bb2877-b8fa-48a6-9116-a874b99a393f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:33.652714 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2bd238b2-3579-484e-9ff0-d0d9aee6e62f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:33.662113 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2bd238b2-3579-484e-9ff0-d0d9aee6e62f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1297 microversion: 2.1 time: 0.109298 May 13 13:25:33.673537 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 160/326] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:33 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1297 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:33.834066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-84bb2877-b8fa-48a6-9116-a874b99a393f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:33.843967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-84bb2877-b8fa-48a6-9116-a874b99a393f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.230844 May 13 13:25:33.856121 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 167/327] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:33 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:34.077739 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7041ce06-6c55-42c3-9a43-8fd98eb2cd39 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:34.078723 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7041ce06-6c55-42c3-9a43-8fd98eb2cd39 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:34.085130 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7041ce06-6c55-42c3-9a43-8fd98eb2cd39 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:34.085581 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7041ce06-6c55-42c3-9a43-8fd98eb2cd39 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:34.086888 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7041ce06-6c55-42c3-9a43-8fd98eb2cd39 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:34.087677 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7041ce06-6c55-42c3-9a43-8fd98eb2cd39 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:34.350787 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7041ce06-6c55-42c3-9a43-8fd98eb2cd39 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:34.362032 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7041ce06-6c55-42c3-9a43-8fd98eb2cd39 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:34.363619 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7041ce06-6c55-42c3-9a43-8fd98eb2cd39 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:34.364916 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7041ce06-6c55-42c3-9a43-8fd98eb2cd39 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1741 microversion: 2.20 time: 0.292078 May 13 13:25:34.366046 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 161/328] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:34 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1741 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:34.564182 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c915e8ab-8604-40cc-a653-db8ae6ad2b6b tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:34.564866 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c915e8ab-8604-40cc-a653-db8ae6ad2b6b tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 2184863b-7be8-470d-9369-12dd0297b6df] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:34.573427 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c915e8ab-8604-40cc-a653-db8ae6ad2b6b tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:34.574557 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c915e8ab-8604-40cc-a653-db8ae6ad2b6b tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:34.575661 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c915e8ab-8604-40cc-a653-db8ae6ad2b6b tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:34.576264 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c915e8ab-8604-40cc-a653-db8ae6ad2b6b tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:34.618815 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c915e8ab-8604-40cc-a653-db8ae6ad2b6b tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:34.619498 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c915e8ab-8604-40cc-a653-db8ae6ad2b6b tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:34.620356 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-c915e8ab-8604-40cc-a653-db8ae6ad2b6b tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lazy-loading 'fault' on Instance uuid 2184863b-7be8-470d-9369-12dd0297b6df {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:25:34.675195 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c915e8ab-8604-40cc-a653-db8ae6ad2b6b tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:34.680660 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a307d5a8-9227-45d2-984c-389aaad7cb9d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:34.681410 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a307d5a8-9227-45d2-984c-389aaad7cb9d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:34.693100 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c915e8ab-8604-40cc-a653-db8ae6ad2b6b tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df" status: 200 len: 1309 microversion: 2.1 time: 0.137246 May 13 13:25:34.693752 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 168/329] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:34 2022] GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df => generated 1309 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:34.705039 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a307d5a8-9227-45d2-984c-389aaad7cb9d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:34.705523 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a307d5a8-9227-45d2-984c-389aaad7cb9d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:34.706344 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a307d5a8-9227-45d2-984c-389aaad7cb9d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:34.706898 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a307d5a8-9227-45d2-984c-389aaad7cb9d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:34.784418 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a307d5a8-9227-45d2-984c-389aaad7cb9d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:34.792486 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a307d5a8-9227-45d2-984c-389aaad7cb9d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1305 microversion: 2.1 time: 0.115506 May 13 13:25:34.793070 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 162/330] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:34 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1305 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:34.872107 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b998b05a-6200-4f1c-94b9-71af0088a4dc tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:34.873659 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b998b05a-6200-4f1c-94b9-71af0088a4dc tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:34.906644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b998b05a-6200-4f1c-94b9-71af0088a4dc tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:34.906644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b998b05a-6200-4f1c-94b9-71af0088a4dc tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:34.906644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b998b05a-6200-4f1c-94b9-71af0088a4dc tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:34.906644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b998b05a-6200-4f1c-94b9-71af0088a4dc tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:35.100405 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b998b05a-6200-4f1c-94b9-71af0088a4dc tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:35.108579 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b998b05a-6200-4f1c-94b9-71af0088a4dc tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.250169 May 13 13:25:35.118698 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 169/331] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:34 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:35.385431 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ed0fbce1-2676-4f73-9de5-d5f0263d7597 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:35.385951 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ed0fbce1-2676-4f73-9de5-d5f0263d7597 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:35.392158 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ed0fbce1-2676-4f73-9de5-d5f0263d7597 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:35.392593 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ed0fbce1-2676-4f73-9de5-d5f0263d7597 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:35.393362 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ed0fbce1-2676-4f73-9de5-d5f0263d7597 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:35.393784 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ed0fbce1-2676-4f73-9de5-d5f0263d7597 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:35.538625 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ed0fbce1-2676-4f73-9de5-d5f0263d7597 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:35.556178 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ed0fbce1-2676-4f73-9de5-d5f0263d7597 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:35.560101 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ed0fbce1-2676-4f73-9de5-d5f0263d7597 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:35.561912 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ed0fbce1-2676-4f73-9de5-d5f0263d7597 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1741 microversion: 2.20 time: 0.180905 May 13 13:25:35.563314 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 163/332] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:35 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1741 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:35.717647 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0ac4e2df-3260-4248-8d01-19d0b5621948 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:35.719083 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0ac4e2df-3260-4248-8d01-19d0b5621948 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 2184863b-7be8-470d-9369-12dd0297b6df] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:35.728806 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0ac4e2df-3260-4248-8d01-19d0b5621948 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:35.729625 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0ac4e2df-3260-4248-8d01-19d0b5621948 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:35.730718 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0ac4e2df-3260-4248-8d01-19d0b5621948 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:35.732085 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0ac4e2df-3260-4248-8d01-19d0b5621948 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:35.781627 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0ac4e2df-3260-4248-8d01-19d0b5621948 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:35.782486 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0ac4e2df-3260-4248-8d01-19d0b5621948 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:35.783274 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-0ac4e2df-3260-4248-8d01-19d0b5621948 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lazy-loading 'fault' on Instance uuid 2184863b-7be8-470d-9369-12dd0297b6df {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:25:35.815445 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-939e64d1-fc94-45cb-89b2-5e945d02995d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:35.817015 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-939e64d1-fc94-45cb-89b2-5e945d02995d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:35.824348 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-939e64d1-fc94-45cb-89b2-5e945d02995d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:35.825377 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-939e64d1-fc94-45cb-89b2-5e945d02995d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:35.826472 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-939e64d1-fc94-45cb-89b2-5e945d02995d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:35.827123 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-939e64d1-fc94-45cb-89b2-5e945d02995d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:35.851396 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0ac4e2df-3260-4248-8d01-19d0b5621948 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:35.862610 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0ac4e2df-3260-4248-8d01-19d0b5621948 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df" status: 200 len: 1309 microversion: 2.1 time: 0.153841 May 13 13:25:35.863494 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 170/333] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:35 2022] GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df => generated 1309 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:35.918462 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-939e64d1-fc94-45cb-89b2-5e945d02995d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:35.930586 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-939e64d1-fc94-45cb-89b2-5e945d02995d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1315 microversion: 2.1 time: 0.116155 May 13 13:25:35.941736 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 164/334] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:35 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1315 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:36.126925 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d8e872b0-e948-45a8-a49c-aaa9bd7c83b1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:36.128379 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d8e872b0-e948-45a8-a49c-aaa9bd7c83b1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:36.137045 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d8e872b0-e948-45a8-a49c-aaa9bd7c83b1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:36.139681 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d8e872b0-e948-45a8-a49c-aaa9bd7c83b1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:36.139681 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d8e872b0-e948-45a8-a49c-aaa9bd7c83b1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:36.139681 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d8e872b0-e948-45a8-a49c-aaa9bd7c83b1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:36.392874 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d8e872b0-e948-45a8-a49c-aaa9bd7c83b1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:36.402262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d8e872b0-e948-45a8-a49c-aaa9bd7c83b1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.279090 May 13 13:25:36.403542 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 171/335] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:36 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:36.583975 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-66a20e19-70c4-45a8-a9e7-7ab2db0ae813 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:36.584938 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-66a20e19-70c4-45a8-a9e7-7ab2db0ae813 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:36.594592 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-66a20e19-70c4-45a8-a9e7-7ab2db0ae813 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:36.595516 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-66a20e19-70c4-45a8-a9e7-7ab2db0ae813 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:36.598060 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-66a20e19-70c4-45a8-a9e7-7ab2db0ae813 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:36.599061 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-66a20e19-70c4-45a8-a9e7-7ab2db0ae813 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:36.817750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-66a20e19-70c4-45a8-a9e7-7ab2db0ae813 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:36.831380 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-66a20e19-70c4-45a8-a9e7-7ab2db0ae813 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:36.833347 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-66a20e19-70c4-45a8-a9e7-7ab2db0ae813 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:36.838577 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-66a20e19-70c4-45a8-a9e7-7ab2db0ae813 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1741 microversion: 2.20 time: 0.255913 May 13 13:25:36.854576 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 165/336] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:36 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1741 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:25:36.880013 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8b6a86a5-ff24-4b37-8685-f87481e38ee2 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:36.881262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8b6a86a5-ff24-4b37-8685-f87481e38ee2 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 2184863b-7be8-470d-9369-12dd0297b6df] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:36.895570 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8b6a86a5-ff24-4b37-8685-f87481e38ee2 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:36.897962 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8b6a86a5-ff24-4b37-8685-f87481e38ee2 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:36.897962 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8b6a86a5-ff24-4b37-8685-f87481e38ee2 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:36.897962 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8b6a86a5-ff24-4b37-8685-f87481e38ee2 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:36.920574 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-8b6a86a5-ff24-4b37-8685-f87481e38ee2 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] HTTP exception thrown: Instance 2184863b-7be8-470d-9369-12dd0297b6df could not be found. May 13 13:25:36.925552 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8b6a86a5-ff24-4b37-8685-f87481e38ee2 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Request method failure captured: May 13 13:25:36.925552 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df HTTP/1.1 May 13 13:25:36.925552 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:25:36.925552 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:25:36.925552 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:25:36.925552 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:25:36.925552 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:25:36.925552 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:25:36.925552 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:25:36.925552 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:25:36.925552 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiflvz18XsfI48PomFulF794TtZnr9EVirDWd_5KXFGXMCmjtl1qa0e9ORkDg0zIBAWaWzKTLlH4U_BsOgWZe0kUcOacfUmsYciaW04LH3gYV7yCjUBtviOehVQerE9pJo0c6EX8uLX5fYe_Af-t6396OncB63iGEoEDb7GE-jmEU2cr4 May 13 13:25:36.925552 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:25:36.925552 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:25:36.925552 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:25:36.925552 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:25:36.925552 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:25:36.925552 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:25:36.925552 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: a06d65a7a7d244d8b8f97aab0ef63684 May 13 13:25:36.925552 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-VolumesSnapshotTestJSON-940237884 May 13 13:25:36.925552 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:25:36.925552 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:25:36.926958 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a06d65a7a7d244d8b8f97aab0ef63684", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a06d65a7a7d244d8b8f97aab0ef63684"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a06d65a7a7d244d8b8f97aab0ef63684"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a06d65a7a7d244d8b8f97aab0ef63684"}]}] May 13 13:25:36.926958 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-VolumesSnapshotTestJSON-940237884 May 13 13:25:36.926958 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: a06d65a7a7d244d8b8f97aab0ef63684 May 13 13:25:36.926958 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-940237884 May 13 13:25:36.926958 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-VolumesSnapshotTestJSON-940237884-project May 13 13:25:36.926958 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:25:36.926958 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:25:36.926958 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: 18b40229043f46fea15181b950a892fd May 13 13:25:36.926958 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-VolumesSnapshotTestJSON-940237884-project May 13 13:25:36.926958 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: > May 13 13:25:36.926958 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Instance 2184863b-7be8-470d-9369-12dd0297b6df could not be found. May 13 13:25:36.926958 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': '2184863b-7be8-470d-9369-12dd0297b6df'} May 13 13:25:36.927891 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:25:36.927891 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:25:36.927891 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:25:36.927891 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:25:36.927891 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:25:36.927891 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:25:36.927891 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:25:36.927891 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:25:36.927891 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:25:36.927891 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:25:36.927891 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2184863b-7be8-470d-9369-12dd0297b6df could not be found. May 13 13:25:36.927891 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:25:36.927891 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:25:36.927891 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:25:36.927891 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:25:36.927891 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:25:36.927891 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:25:36.927891 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:25:36.927891 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:25:36.927891 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:25:36.929399 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:25:36.929399 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:25:36.929399 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:25:36.929399 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:25:36.929399 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:25:36.929399 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:25:36.929399 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:25:36.929399 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2184863b-7be8-470d-9369-12dd0297b6df could not be found. May 13 13:25:36.929399 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:25:36.929399 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:25:36.929399 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:25:36.929399 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:25:36.929399 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:25:36.929399 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:25:36.929399 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:25:36.929399 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:25:36.929399 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2184863b-7be8-470d-9369-12dd0297b6df could not be found. May 13 13:25:36.929399 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:25:36.938553 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8b6a86a5-ff24-4b37-8685-f87481e38ee2 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Returning 404 to user: Instance 2184863b-7be8-470d-9369-12dd0297b6df could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:25:36.938553 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8b6a86a5-ff24-4b37-8685-f87481e38ee2 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df" status: 404 len: 111 microversion: 2.1 time: 0.051251 May 13 13:25:36.938553 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 172/337] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:36 2022] GET /compute/v2.1/servers/2184863b-7be8-470d-9369-12dd0297b6df => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:25:36.951952 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1c4c783c-db66-4d69-89ae-9a63ce57a818 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:36.952863 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1c4c783c-db66-4d69-89ae-9a63ce57a818 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:36.965406 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1c4c783c-db66-4d69-89ae-9a63ce57a818 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:36.969852 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1c4c783c-db66-4d69-89ae-9a63ce57a818 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:36.973125 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1c4c783c-db66-4d69-89ae-9a63ce57a818 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:36.978834 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1c4c783c-db66-4d69-89ae-9a63ce57a818 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:37.213801 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1c4c783c-db66-4d69-89ae-9a63ce57a818 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:37.246949 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1c4c783c-db66-4d69-89ae-9a63ce57a818 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1370 microversion: 2.1 time: 0.301371 May 13 13:25:37.248767 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 166/338] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:36 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1370 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:37.424033 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4e6d387c-d7e9-43e8-8249-16c4b6a55d90 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:37.426047 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4e6d387c-d7e9-43e8-8249-16c4b6a55d90 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:37.439658 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4e6d387c-d7e9-43e8-8249-16c4b6a55d90 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:37.439658 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4e6d387c-d7e9-43e8-8249-16c4b6a55d90 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:37.439658 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4e6d387c-d7e9-43e8-8249-16c4b6a55d90 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:37.439658 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4e6d387c-d7e9-43e8-8249-16c4b6a55d90 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:37.661836 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-535a06e0-b52e-479c-9a3a-0fd20ce5072c req-3c6613bc-3ac4-495a-927d-8f4bd1d98bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba162312-5c53-4320-acc9-4e2566f27686", "tag": "bc491e34-66dc-4f6f-9292-c68b5d9c9928"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:37.671405 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4e6d387c-d7e9-43e8-8249-16c4b6a55d90 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:37.681916 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4e6d387c-d7e9-43e8-8249-16c4b6a55d90 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.265630 May 13 13:25:37.685276 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-535a06e0-b52e-479c-9a3a-0fd20ce5072c req-3c6613bc-3ac4-495a-927d-8f4bd1d98bd4 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:37.686872 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-535a06e0-b52e-479c-9a3a-0fd20ce5072c req-3c6613bc-3ac4-495a-927d-8f4bd1d98bd4 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:37.695683 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 173/339] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:37 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:37.713309 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-535a06e0-b52e-479c-9a3a-0fd20ce5072c req-3c6613bc-3ac4-495a-927d-8f4bd1d98bd4 service nova] Creating event network-changed:bc491e34-66dc-4f6f-9292-c68b5d9c9928 for instance ba162312-5c53-4320-acc9-4e2566f27686 on hv-cinder-84163 May 13 13:25:37.734651 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-535a06e0-b52e-479c-9a3a-0fd20ce5072c req-3c6613bc-3ac4-495a-927d-8f4bd1d98bd4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076713 May 13 13:25:37.736275 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 167/340] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:25:37.858826 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6a593d1e-51bf-4e8a-be38-3d487ab2d4f5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:37.859443 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6a593d1e-51bf-4e8a-be38-3d487ab2d4f5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:37.868853 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6a593d1e-51bf-4e8a-be38-3d487ab2d4f5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:37.873764 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6a593d1e-51bf-4e8a-be38-3d487ab2d4f5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:37.875160 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6a593d1e-51bf-4e8a-be38-3d487ab2d4f5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:37.875839 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6a593d1e-51bf-4e8a-be38-3d487ab2d4f5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:38.055741 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6a593d1e-51bf-4e8a-be38-3d487ab2d4f5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:38.066501 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6a593d1e-51bf-4e8a-be38-3d487ab2d4f5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:38.068012 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6a593d1e-51bf-4e8a-be38-3d487ab2d4f5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:38.069232 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6a593d1e-51bf-4e8a-be38-3d487ab2d4f5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1741 microversion: 2.20 time: 0.214868 May 13 13:25:38.070168 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 174/341] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:37 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1741 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:38.268194 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c06813ac-f70e-4cd8-a199-fd16116fd578 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:38.268809 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c06813ac-f70e-4cd8-a199-fd16116fd578 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:38.276171 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c06813ac-f70e-4cd8-a199-fd16116fd578 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:38.276540 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c06813ac-f70e-4cd8-a199-fd16116fd578 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:38.277442 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c06813ac-f70e-4cd8-a199-fd16116fd578 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:38.277958 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c06813ac-f70e-4cd8-a199-fd16116fd578 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:38.469879 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c06813ac-f70e-4cd8-a199-fd16116fd578 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:38.477923 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c06813ac-f70e-4cd8-a199-fd16116fd578 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1370 microversion: 2.1 time: 0.216371 May 13 13:25:38.478555 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 168/342] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:38 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1370 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:38.703583 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-aedbf4fd-ab4f-4148-be52-e43a39af702a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:38.704193 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-aedbf4fd-ab4f-4148-be52-e43a39af702a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:38.710741 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aedbf4fd-ab4f-4148-be52-e43a39af702a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:38.711129 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aedbf4fd-ab4f-4148-be52-e43a39af702a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:38.712181 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aedbf4fd-ab4f-4148-be52-e43a39af702a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:38.712621 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aedbf4fd-ab4f-4148-be52-e43a39af702a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:38.865309 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-aedbf4fd-ab4f-4148-be52-e43a39af702a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:38.876144 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-aedbf4fd-ab4f-4148-be52-e43a39af702a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.177153 May 13 13:25:38.885325 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 175/343] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:38 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:39.088534 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-25f493a6-49aa-433f-b1f3-4128d8a15f5c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:39.089144 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-25f493a6-49aa-433f-b1f3-4128d8a15f5c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:39.095671 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-25f493a6-49aa-433f-b1f3-4128d8a15f5c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:39.096115 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-25f493a6-49aa-433f-b1f3-4128d8a15f5c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:39.096881 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-25f493a6-49aa-433f-b1f3-4128d8a15f5c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:39.097328 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-25f493a6-49aa-433f-b1f3-4128d8a15f5c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:39.251770 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-25f493a6-49aa-433f-b1f3-4128d8a15f5c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:39.259967 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-25f493a6-49aa-433f-b1f3-4128d8a15f5c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:39.261561 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-25f493a6-49aa-433f-b1f3-4128d8a15f5c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:39.263503 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-25f493a6-49aa-433f-b1f3-4128d8a15f5c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1741 microversion: 2.20 time: 0.179342 May 13 13:25:39.264130 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 169/344] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:39 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:39.495684 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ba03a986-2b1a-4397-a818-cf18349dd4f9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:39.496304 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ba03a986-2b1a-4397-a818-cf18349dd4f9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:39.503538 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ba03a986-2b1a-4397-a818-cf18349dd4f9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:39.503987 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ba03a986-2b1a-4397-a818-cf18349dd4f9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:39.504750 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ba03a986-2b1a-4397-a818-cf18349dd4f9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:39.505183 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ba03a986-2b1a-4397-a818-cf18349dd4f9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:39.640273 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ba03a986-2b1a-4397-a818-cf18349dd4f9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:39.660758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ba03a986-2b1a-4397-a818-cf18349dd4f9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1370 microversion: 2.1 time: 0.156199 May 13 13:25:39.660758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 176/345] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:39 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:39.893324 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-60508765-dd6b-4fa7-8070-63687eb7314f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:39.893943 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-60508765-dd6b-4fa7-8070-63687eb7314f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:39.901761 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-60508765-dd6b-4fa7-8070-63687eb7314f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:39.902241 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-60508765-dd6b-4fa7-8070-63687eb7314f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:39.903553 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-60508765-dd6b-4fa7-8070-63687eb7314f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:39.904844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-60508765-dd6b-4fa7-8070-63687eb7314f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:40.071143 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-60508765-dd6b-4fa7-8070-63687eb7314f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:40.080437 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-60508765-dd6b-4fa7-8070-63687eb7314f tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.190810 May 13 13:25:40.081129 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 170/346] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:39 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:40.283244 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c03c714d-9ce9-42e1-8b97-be22df5f1763 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:40.284048 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c03c714d-9ce9-42e1-8b97-be22df5f1763 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:40.290953 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c03c714d-9ce9-42e1-8b97-be22df5f1763 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:40.291591 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c03c714d-9ce9-42e1-8b97-be22df5f1763 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:40.292482 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c03c714d-9ce9-42e1-8b97-be22df5f1763 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:40.292847 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c03c714d-9ce9-42e1-8b97-be22df5f1763 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:40.443019 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c03c714d-9ce9-42e1-8b97-be22df5f1763 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:40.453096 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c03c714d-9ce9-42e1-8b97-be22df5f1763 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:40.454747 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c03c714d-9ce9-42e1-8b97-be22df5f1763 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:40.456269 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c03c714d-9ce9-42e1-8b97-be22df5f1763 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1741 microversion: 2.20 time: 0.177875 May 13 13:25:40.457267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 177/347] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:40 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:40.666901 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-73cd10fb-b4c1-41cb-b7fa-13a52bf9cb76 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:40.667736 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-73cd10fb-b4c1-41cb-b7fa-13a52bf9cb76 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:40.676472 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-73cd10fb-b4c1-41cb-b7fa-13a52bf9cb76 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:40.677167 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-73cd10fb-b4c1-41cb-b7fa-13a52bf9cb76 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:40.678172 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-73cd10fb-b4c1-41cb-b7fa-13a52bf9cb76 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:40.678827 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-73cd10fb-b4c1-41cb-b7fa-13a52bf9cb76 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:40.897444 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-73cd10fb-b4c1-41cb-b7fa-13a52bf9cb76 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:40.911819 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-73cd10fb-b4c1-41cb-b7fa-13a52bf9cb76 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1370 microversion: 2.1 time: 0.248856 May 13 13:25:40.913023 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 171/348] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:40 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1370 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:41.100217 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4ae68ae9-8029-4b1a-bcb6-0c2d3da720a2 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:41.103235 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4ae68ae9-8029-4b1a-bcb6-0c2d3da720a2 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:41.115944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4ae68ae9-8029-4b1a-bcb6-0c2d3da720a2 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:41.116665 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4ae68ae9-8029-4b1a-bcb6-0c2d3da720a2 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:41.118374 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4ae68ae9-8029-4b1a-bcb6-0c2d3da720a2 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:41.118374 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4ae68ae9-8029-4b1a-bcb6-0c2d3da720a2 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:41.326165 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4ae68ae9-8029-4b1a-bcb6-0c2d3da720a2 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:41.336656 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4ae68ae9-8029-4b1a-bcb6-0c2d3da720a2 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.241359 May 13 13:25:41.338011 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 178/349] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:41 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:41.475166 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-307e3415-da58-4a31-932e-e8784b293096 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:41.475785 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-307e3415-da58-4a31-932e-e8784b293096 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:41.486078 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-307e3415-da58-4a31-932e-e8784b293096 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:41.487152 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-307e3415-da58-4a31-932e-e8784b293096 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:41.488258 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-307e3415-da58-4a31-932e-e8784b293096 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:41.488909 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-307e3415-da58-4a31-932e-e8784b293096 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:41.661906 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-307e3415-da58-4a31-932e-e8784b293096 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:41.674841 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-307e3415-da58-4a31-932e-e8784b293096 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:41.677708 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-307e3415-da58-4a31-932e-e8784b293096 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:41.679536 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-307e3415-da58-4a31-932e-e8784b293096 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1741 microversion: 2.20 time: 0.208431 May 13 13:25:41.680114 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 172/350] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:41 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1741 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:41.929638 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-dfa1d74a-7841-4bf4-9a88-fdb03b63a895 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:41.930716 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-dfa1d74a-7841-4bf4-9a88-fdb03b63a895 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:41.939799 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dfa1d74a-7841-4bf4-9a88-fdb03b63a895 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:41.940267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dfa1d74a-7841-4bf4-9a88-fdb03b63a895 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:41.941026 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dfa1d74a-7841-4bf4-9a88-fdb03b63a895 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:41.941450 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dfa1d74a-7841-4bf4-9a88-fdb03b63a895 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:42.176626 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-dfa1d74a-7841-4bf4-9a88-fdb03b63a895 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:42.185717 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-dfa1d74a-7841-4bf4-9a88-fdb03b63a895 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1370 microversion: 2.1 time: 0.259430 May 13 13:25:42.186336 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 179/351] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:41 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1370 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:42.357756 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-47914943-4666-4a2e-a5c8-f11af496e75e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:42.358451 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-47914943-4666-4a2e-a5c8-f11af496e75e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:42.365495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-47914943-4666-4a2e-a5c8-f11af496e75e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:42.365940 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-47914943-4666-4a2e-a5c8-f11af496e75e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:42.367014 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-47914943-4666-4a2e-a5c8-f11af496e75e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:42.367455 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-47914943-4666-4a2e-a5c8-f11af496e75e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:42.539012 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-47914943-4666-4a2e-a5c8-f11af496e75e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:42.546006 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-47914943-4666-4a2e-a5c8-f11af496e75e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.192444 May 13 13:25:42.546615 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 173/352] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:42 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:42.697825 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8c4f47c4-9bef-4356-a84b-f1a379562150 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:42.698362 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8c4f47c4-9bef-4356-a84b-f1a379562150 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:42.704782 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c4f47c4-9bef-4356-a84b-f1a379562150 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:42.705229 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c4f47c4-9bef-4356-a84b-f1a379562150 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:42.705992 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c4f47c4-9bef-4356-a84b-f1a379562150 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:42.706472 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c4f47c4-9bef-4356-a84b-f1a379562150 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:42.862759 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8c4f47c4-9bef-4356-a84b-f1a379562150 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:42.870977 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8c4f47c4-9bef-4356-a84b-f1a379562150 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:42.872714 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8c4f47c4-9bef-4356-a84b-f1a379562150 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:42.873868 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8c4f47c4-9bef-4356-a84b-f1a379562150 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1741 microversion: 2.20 time: 0.180009 May 13 13:25:42.874487 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 180/353] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:42 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:43.206863 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4f58f2a5-37b0-4722-aeae-16603e992a4b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:43.207479 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4f58f2a5-37b0-4722-aeae-16603e992a4b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:43.213869 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4f58f2a5-37b0-4722-aeae-16603e992a4b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:43.214403 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4f58f2a5-37b0-4722-aeae-16603e992a4b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:43.215566 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4f58f2a5-37b0-4722-aeae-16603e992a4b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:43.216026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4f58f2a5-37b0-4722-aeae-16603e992a4b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:43.351640 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4f58f2a5-37b0-4722-aeae-16603e992a4b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:43.360033 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4f58f2a5-37b0-4722-aeae-16603e992a4b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1370 microversion: 2.1 time: 0.157377 May 13 13:25:43.360681 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 174/354] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:43 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:43.564742 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-fed07643-3c1f-4a56-acba-d6dbf33dc41e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:43.566021 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-fed07643-3c1f-4a56-acba-d6dbf33dc41e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:43.572967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fed07643-3c1f-4a56-acba-d6dbf33dc41e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:43.574308 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fed07643-3c1f-4a56-acba-d6dbf33dc41e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:43.575649 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fed07643-3c1f-4a56-acba-d6dbf33dc41e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:43.576260 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fed07643-3c1f-4a56-acba-d6dbf33dc41e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:43.800816 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-fed07643-3c1f-4a56-acba-d6dbf33dc41e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:43.811119 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-fed07643-3c1f-4a56-acba-d6dbf33dc41e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.250498 May 13 13:25:43.812042 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 181/355] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:43 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:43.895519 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-285c3a09-a303-4ceb-941c-88be2b3cbbd2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:43.896123 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-285c3a09-a303-4ceb-941c-88be2b3cbbd2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:43.911107 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-285c3a09-a303-4ceb-941c-88be2b3cbbd2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:43.915615 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-285c3a09-a303-4ceb-941c-88be2b3cbbd2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:43.915615 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-285c3a09-a303-4ceb-941c-88be2b3cbbd2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:43.915615 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-285c3a09-a303-4ceb-941c-88be2b3cbbd2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:44.094463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-285c3a09-a303-4ceb-941c-88be2b3cbbd2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:44.104209 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-285c3a09-a303-4ceb-941c-88be2b3cbbd2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:44.105710 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-285c3a09-a303-4ceb-941c-88be2b3cbbd2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:44.107709 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-285c3a09-a303-4ceb-941c-88be2b3cbbd2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1741 microversion: 2.20 time: 0.216158 May 13 13:25:44.118946 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 175/356] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:43 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1741 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:44.378260 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cecc7535-7f7d-4277-9df0-e95ce33e894d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:44.378932 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-cecc7535-7f7d-4277-9df0-e95ce33e894d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:44.385433 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cecc7535-7f7d-4277-9df0-e95ce33e894d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:44.385594 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cecc7535-7f7d-4277-9df0-e95ce33e894d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:44.386309 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cecc7535-7f7d-4277-9df0-e95ce33e894d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:44.386738 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cecc7535-7f7d-4277-9df0-e95ce33e894d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:44.526686 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-cecc7535-7f7d-4277-9df0-e95ce33e894d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:44.534213 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-cecc7535-7f7d-4277-9df0-e95ce33e894d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1370 microversion: 2.1 time: 0.160971 May 13 13:25:44.534722 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 182/357] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:44 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:44.828219 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4bca0453-cfa0-4724-9b7f-0bcbbcef8320 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:44.828819 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4bca0453-cfa0-4724-9b7f-0bcbbcef8320 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:44.834733 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4bca0453-cfa0-4724-9b7f-0bcbbcef8320 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:44.835172 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4bca0453-cfa0-4724-9b7f-0bcbbcef8320 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:44.835926 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4bca0453-cfa0-4724-9b7f-0bcbbcef8320 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:44.836353 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4bca0453-cfa0-4724-9b7f-0bcbbcef8320 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:44.972681 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4bca0453-cfa0-4724-9b7f-0bcbbcef8320 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:44.981492 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4bca0453-cfa0-4724-9b7f-0bcbbcef8320 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.156763 May 13 13:25:44.983390 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 176/358] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:44 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:45.125986 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-01f4fb14-4256-4098-bc3d-a871e04067fa tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:45.126625 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-01f4fb14-4256-4098-bc3d-a871e04067fa tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:45.133298 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-01f4fb14-4256-4098-bc3d-a871e04067fa tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:45.133743 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-01f4fb14-4256-4098-bc3d-a871e04067fa tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:45.134540 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-01f4fb14-4256-4098-bc3d-a871e04067fa tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:45.134965 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-01f4fb14-4256-4098-bc3d-a871e04067fa tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:45.276524 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-01f4fb14-4256-4098-bc3d-a871e04067fa tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:45.284931 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-01f4fb14-4256-4098-bc3d-a871e04067fa tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:45.286478 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-01f4fb14-4256-4098-bc3d-a871e04067fa tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:45.287617 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-01f4fb14-4256-4098-bc3d-a871e04067fa tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1741 microversion: 2.20 time: 0.165502 May 13 13:25:45.288170 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 183/359] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:45 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:45.550909 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-56c4dda0-0c02-4674-8d5e-110a47662b81 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:45.551505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-56c4dda0-0c02-4674-8d5e-110a47662b81 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:45.557706 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-56c4dda0-0c02-4674-8d5e-110a47662b81 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:45.558150 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-56c4dda0-0c02-4674-8d5e-110a47662b81 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:45.558935 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-56c4dda0-0c02-4674-8d5e-110a47662b81 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:45.559371 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-56c4dda0-0c02-4674-8d5e-110a47662b81 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:45.698186 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-56c4dda0-0c02-4674-8d5e-110a47662b81 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:45.706390 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-56c4dda0-0c02-4674-8d5e-110a47662b81 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1370 microversion: 2.1 time: 0.159178 May 13 13:25:45.716664 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 177/360] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:45 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:46.001350 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1114121f-4c7c-407a-ae65-33fd8d07363b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:46.002414 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1114121f-4c7c-407a-ae65-33fd8d07363b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:46.009098 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1114121f-4c7c-407a-ae65-33fd8d07363b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:46.009539 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1114121f-4c7c-407a-ae65-33fd8d07363b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:46.016217 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1114121f-4c7c-407a-ae65-33fd8d07363b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:46.016217 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1114121f-4c7c-407a-ae65-33fd8d07363b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:46.156526 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1114121f-4c7c-407a-ae65-33fd8d07363b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:46.165216 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1114121f-4c7c-407a-ae65-33fd8d07363b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1722 microversion: 2.1 time: 0.169311 May 13 13:25:46.165818 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 184/361] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:45 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:46.306657 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9e97759c-f2c2-43e9-9de5-2fcc501ec09c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:46.307321 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9e97759c-f2c2-43e9-9de5-2fcc501ec09c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:46.314860 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9e97759c-f2c2-43e9-9de5-2fcc501ec09c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:46.315311 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9e97759c-f2c2-43e9-9de5-2fcc501ec09c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:46.318844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9e97759c-f2c2-43e9-9de5-2fcc501ec09c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:46.318844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9e97759c-f2c2-43e9-9de5-2fcc501ec09c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:46.452679 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9e97759c-f2c2-43e9-9de5-2fcc501ec09c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:46.461164 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9e97759c-f2c2-43e9-9de5-2fcc501ec09c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:46.463146 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9e97759c-f2c2-43e9-9de5-2fcc501ec09c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:46.464308 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9e97759c-f2c2-43e9-9de5-2fcc501ec09c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1741 microversion: 2.20 time: 0.161578 May 13 13:25:46.465028 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 178/362] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:46 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1741 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:46.724173 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-dab0d500-4d85-4636-96ce-bea1b8f95b70 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:46.724778 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-dab0d500-4d85-4636-96ce-bea1b8f95b70 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:46.730795 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dab0d500-4d85-4636-96ce-bea1b8f95b70 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:46.732564 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dab0d500-4d85-4636-96ce-bea1b8f95b70 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:46.733345 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dab0d500-4d85-4636-96ce-bea1b8f95b70 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:46.733782 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dab0d500-4d85-4636-96ce-bea1b8f95b70 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:46.876868 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-dab0d500-4d85-4636-96ce-bea1b8f95b70 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:46.884376 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-dab0d500-4d85-4636-96ce-bea1b8f95b70 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1370 microversion: 2.1 time: 0.164195 May 13 13:25:46.884936 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 185/363] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:46 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:47.183042 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-64b817b4-010c-4935-8f91-171ba46fab10 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:47.183659 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-64b817b4-010c-4935-8f91-171ba46fab10 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:47.191836 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-64b817b4-010c-4935-8f91-171ba46fab10 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:47.192155 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-64b817b4-010c-4935-8f91-171ba46fab10 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:47.193312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-64b817b4-010c-4935-8f91-171ba46fab10 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:47.196333 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-64b817b4-010c-4935-8f91-171ba46fab10 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:47.359156 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-64b817b4-010c-4935-8f91-171ba46fab10 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:47.367160 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-64b817b4-010c-4935-8f91-171ba46fab10 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1699 microversion: 2.1 time: 0.188265 May 13 13:25:47.367760 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 179/364] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:47 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1699 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:47.385378 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0d6f0135-8d9d-4680-9f8d-4981f0739ea3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:47.392607 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0d6f0135-8d9d-4680-9f8d-4981f0739ea3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:47.393083 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0d6f0135-8d9d-4680-9f8d-4981f0739ea3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:47.415166 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0d6f0135-8d9d-4680-9f8d-4981f0739ea3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Going to try to start instance {{(pid=117721) start /opt/stack/nova/nova/compute/api.py:2730}} May 13 13:25:47.483776 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0b09b59f-2ee4-4051-b85b-a4ea5f2b2d3f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:47.484403 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0b09b59f-2ee4-4051-b85b-a4ea5f2b2d3f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:47.491782 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0b09b59f-2ee4-4051-b85b-a4ea5f2b2d3f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:47.492394 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0b09b59f-2ee4-4051-b85b-a4ea5f2b2d3f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:47.493314 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0b09b59f-2ee4-4051-b85b-a4ea5f2b2d3f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:47.493747 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0b09b59f-2ee4-4051-b85b-a4ea5f2b2d3f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:47.644571 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0d6f0135-8d9d-4680-9f8d-4981f0739ea3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "POST /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86/action" status: 202 len: 0 microversion: 2.1 time: 0.261265 May 13 13:25:47.652478 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 186/365] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 13 13:25:47 2022] POST /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 13:25:47.665480 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cdf14ea5-486e-4a4f-a0dc-24e0c9695f8c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:47.666250 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-cdf14ea5-486e-4a4f-a0dc-24e0c9695f8c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:47.666931 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0b09b59f-2ee4-4051-b85b-a4ea5f2b2d3f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:47.676857 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cdf14ea5-486e-4a4f-a0dc-24e0c9695f8c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:47.679255 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cdf14ea5-486e-4a4f-a0dc-24e0c9695f8c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:47.679255 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cdf14ea5-486e-4a4f-a0dc-24e0c9695f8c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:47.679255 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cdf14ea5-486e-4a4f-a0dc-24e0c9695f8c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:47.683146 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0b09b59f-2ee4-4051-b85b-a4ea5f2b2d3f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:47.685176 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0b09b59f-2ee4-4051-b85b-a4ea5f2b2d3f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:47.686631 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0b09b59f-2ee4-4051-b85b-a4ea5f2b2d3f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1723 microversion: 2.20 time: 0.207906 May 13 13:25:47.696996 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 180/366] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:47 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:25:47.831834 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-cdf14ea5-486e-4a4f-a0dc-24e0c9695f8c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:47.839905 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-cdf14ea5-486e-4a4f-a0dc-24e0c9695f8c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1708 microversion: 2.1 time: 0.184151 May 13 13:25:47.840781 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 187/367] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:47 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1708 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:47.907048 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8280bcf8-6152-4cab-be82-cb565fe7c397 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:47.907805 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8280bcf8-6152-4cab-be82-cb565fe7c397 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:47.914093 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8280bcf8-6152-4cab-be82-cb565fe7c397 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:47.914573 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8280bcf8-6152-4cab-be82-cb565fe7c397 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:47.915383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8280bcf8-6152-4cab-be82-cb565fe7c397 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:47.915821 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8280bcf8-6152-4cab-be82-cb565fe7c397 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:48.014740 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-58284584-f22a-4eb2-9afb-b8e164d3bf35 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1323504121", "imageRef": "ece294e8-5415-4d6a-a0d3-a14539c51c0a", "flavorRef": "452", "networks": [{"uuid": "7c2089ae-3254-4393-9e50-1eb3fedb8e31"}]}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:48.069270 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8280bcf8-6152-4cab-be82-cb565fe7c397 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:48.071077 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.network.neutron [None req-58284584-f22a-4eb2-9afb-b8e164d3bf35 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] validate_networks() for [('7c2089ae-3254-4393-9e50-1eb3fedb8e31', None, None, None, None, None)] {{(pid=117721) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:25:48.078868 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8280bcf8-6152-4cab-be82-cb565fe7c397 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1370 microversion: 2.1 time: 0.174543 May 13 13:25:48.088225 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 181/368] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:47 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:48.441345 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-58284584-f22a-4eb2-9afb-b8e164d3bf35 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Flavor limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:25:48.441838 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-58284584-f22a-4eb2-9afb-b8e164d3bf35 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Image limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:25:48.442284 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-58284584-f22a-4eb2-9afb-b8e164d3bf35 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Flavor pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:25:48.442822 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-58284584-f22a-4eb2-9afb-b8e164d3bf35 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Image pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:25:48.443238 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-58284584-f22a-4eb2-9afb-b8e164d3bf35 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:25:48.453850 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-58284584-f22a-4eb2-9afb-b8e164d3bf35 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:48.454333 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-58284584-f22a-4eb2-9afb-b8e164d3bf35 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:48.455139 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-58284584-f22a-4eb2-9afb-b8e164d3bf35 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:48.455575 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-58284584-f22a-4eb2-9afb-b8e164d3bf35 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:48.472529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-58284584-f22a-4eb2-9afb-b8e164d3bf35 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Getting quotas for project a06d65a7a7d244d8b8f97aab0ef63684. Resources: {'cores', 'instances', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:25:48.476486 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-58284584-f22a-4eb2-9afb-b8e164d3bf35 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Getting quotas for user 18b40229043f46fea15181b950a892fd and project a06d65a7a7d244d8b8f97aab0ef63684. Resources: {'cores', 'instances', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:25:48.488801 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-58284584-f22a-4eb2-9afb-b8e164d3bf35 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Going to run 1 instances... {{(pid=117721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:25:48.491109 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-58284584-f22a-4eb2-9afb-b8e164d3bf35 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 7d22c736-3272-4f3c-950b-12fc33d878ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ece294e8-5415-4d6a-a0d3-a14539c51c0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:25:48.622039 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-58284584-f22a-4eb2-9afb-b8e164d3bf35 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.611277 May 13 13:25:48.622832 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 188/369] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 13 13:25:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 13:25:48.633021 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c4013229-eb0e-4b2e-bccd-4208bc3a3891 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:48.633632 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c4013229-eb0e-4b2e-bccd-4208bc3a3891 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 7d22c736-3272-4f3c-950b-12fc33d878ba] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:48.689002 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c4013229-eb0e-4b2e-bccd-4208bc3a3891 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:48.695854 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c4013229-eb0e-4b2e-bccd-4208bc3a3891 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba" status: 200 len: 1219 microversion: 2.1 time: 0.066708 May 13 13:25:48.696439 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 182/370] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:48 2022] GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:48.708956 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-72b35f2d-4ce5-46a8-8267-e84a44e07e90 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:48.709563 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-72b35f2d-4ce5-46a8-8267-e84a44e07e90 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:48.717007 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72b35f2d-4ce5-46a8-8267-e84a44e07e90 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:48.717455 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72b35f2d-4ce5-46a8-8267-e84a44e07e90 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:48.718345 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72b35f2d-4ce5-46a8-8267-e84a44e07e90 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:48.718719 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72b35f2d-4ce5-46a8-8267-e84a44e07e90 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:48.861493 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0d58e52b-24f3-4ef7-a407-c4df436bb0b2 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:48.862120 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0d58e52b-24f3-4ef7-a407-c4df436bb0b2 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:48.864116 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-72b35f2d-4ce5-46a8-8267-e84a44e07e90 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:48.868653 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0d58e52b-24f3-4ef7-a407-c4df436bb0b2 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:48.869093 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0d58e52b-24f3-4ef7-a407-c4df436bb0b2 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:48.870057 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0d58e52b-24f3-4ef7-a407-c4df436bb0b2 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:48.870517 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0d58e52b-24f3-4ef7-a407-c4df436bb0b2 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:48.880797 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-72b35f2d-4ce5-46a8-8267-e84a44e07e90 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:48.882983 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-72b35f2d-4ce5-46a8-8267-e84a44e07e90 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:48.884349 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-72b35f2d-4ce5-46a8-8267-e84a44e07e90 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1723 microversion: 2.20 time: 0.179472 May 13 13:25:48.884913 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 189/371] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:48 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:49.009092 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0d58e52b-24f3-4ef7-a407-c4df436bb0b2 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:49.018622 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0d58e52b-24f3-4ef7-a407-c4df436bb0b2 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1708 microversion: 2.1 time: 0.161848 May 13 13:25:49.019413 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 183/372] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:48 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1708 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:49.096880 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7b0f757a-922e-4b7f-b1c4-8b83fdf3906d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:49.097556 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7b0f757a-922e-4b7f-b1c4-8b83fdf3906d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:49.104046 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7b0f757a-922e-4b7f-b1c4-8b83fdf3906d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:49.104486 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7b0f757a-922e-4b7f-b1c4-8b83fdf3906d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:49.105244 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7b0f757a-922e-4b7f-b1c4-8b83fdf3906d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:49.105664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7b0f757a-922e-4b7f-b1c4-8b83fdf3906d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:49.251948 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7b0f757a-922e-4b7f-b1c4-8b83fdf3906d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:49.259564 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7b0f757a-922e-4b7f-b1c4-8b83fdf3906d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1370 microversion: 2.1 time: 0.166626 May 13 13:25:49.260143 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 190/373] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:49 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:49.483304 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-1bacef09-fbc0-48a4-95cc-e1b7a5ca0314 req-c1c3c249-341e-48fa-b13c-1729a0c51f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba162312-5c53-4320-acc9-4e2566f27686", "name": "network-vif-plugged", "status": "completed", "tag": "bc491e34-66dc-4f6f-9292-c68b5d9c9928"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:49.492927 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-1bacef09-fbc0-48a4-95cc-e1b7a5ca0314 req-c1c3c249-341e-48fa-b13c-1729a0c51f8b service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:49.493366 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-1bacef09-fbc0-48a4-95cc-e1b7a5ca0314 req-c1c3c249-341e-48fa-b13c-1729a0c51f8b service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:49.504766 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-1bacef09-fbc0-48a4-95cc-e1b7a5ca0314 req-c1c3c249-341e-48fa-b13c-1729a0c51f8b service nova] Creating event network-vif-plugged:bc491e34-66dc-4f6f-9292-c68b5d9c9928 for instance ba162312-5c53-4320-acc9-4e2566f27686 on hv-cinder-84163 May 13 13:25:49.509787 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-1bacef09-fbc0-48a4-95cc-e1b7a5ca0314 req-c1c3c249-341e-48fa-b13c-1729a0c51f8b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030322 May 13 13:25:49.513977 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 184/374] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:25:49.713541 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-70086431-fe8c-4f43-9998-2e2fe205094f tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:49.714064 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-70086431-fe8c-4f43-9998-2e2fe205094f tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 7d22c736-3272-4f3c-950b-12fc33d878ba] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:49.721008 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-70086431-fe8c-4f43-9998-2e2fe205094f tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:49.721447 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-70086431-fe8c-4f43-9998-2e2fe205094f tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:49.722219 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-70086431-fe8c-4f43-9998-2e2fe205094f tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:49.722752 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-70086431-fe8c-4f43-9998-2e2fe205094f tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:49.795577 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-70086431-fe8c-4f43-9998-2e2fe205094f tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:49.803955 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-70086431-fe8c-4f43-9998-2e2fe205094f tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba" status: 200 len: 1223 microversion: 2.1 time: 0.094528 May 13 13:25:49.804631 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 191/375] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:49 2022] GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:49.905451 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c8693471-9253-4d5b-9136-eea026bbd61a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:49.906134 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c8693471-9253-4d5b-9136-eea026bbd61a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:49.915023 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c8693471-9253-4d5b-9136-eea026bbd61a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:49.915844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c8693471-9253-4d5b-9136-eea026bbd61a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:49.916736 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c8693471-9253-4d5b-9136-eea026bbd61a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:49.917175 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c8693471-9253-4d5b-9136-eea026bbd61a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:50.039140 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c3f6e881-605b-41e0-b0c4-9855c3ea8b8c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:50.039140 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c3f6e881-605b-41e0-b0c4-9855c3ea8b8c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:50.046180 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c3f6e881-605b-41e0-b0c4-9855c3ea8b8c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:50.046684 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c3f6e881-605b-41e0-b0c4-9855c3ea8b8c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:50.047644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c3f6e881-605b-41e0-b0c4-9855c3ea8b8c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:50.048018 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c3f6e881-605b-41e0-b0c4-9855c3ea8b8c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:50.063717 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c8693471-9253-4d5b-9136-eea026bbd61a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:50.071857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c8693471-9253-4d5b-9136-eea026bbd61a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:50.073367 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c8693471-9253-4d5b-9136-eea026bbd61a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:50.074551 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c8693471-9253-4d5b-9136-eea026bbd61a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1723 microversion: 2.20 time: 0.174340 May 13 13:25:50.075661 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 185/376] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:49 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:50.181304 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c3f6e881-605b-41e0-b0c4-9855c3ea8b8c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:50.189486 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c3f6e881-605b-41e0-b0c4-9855c3ea8b8c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1708 microversion: 2.1 time: 0.156640 May 13 13:25:50.190054 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 192/377] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:50 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1708 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:50.277023 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-00e6ec34-8cc0-4e7b-b684-5cd12e9396b2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:50.277829 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-00e6ec34-8cc0-4e7b-b684-5cd12e9396b2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:50.284803 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-00e6ec34-8cc0-4e7b-b684-5cd12e9396b2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:50.285249 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-00e6ec34-8cc0-4e7b-b684-5cd12e9396b2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:50.286064 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-00e6ec34-8cc0-4e7b-b684-5cd12e9396b2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:50.286531 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-00e6ec34-8cc0-4e7b-b684-5cd12e9396b2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:50.437277 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-00e6ec34-8cc0-4e7b-b684-5cd12e9396b2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:50.445493 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-00e6ec34-8cc0-4e7b-b684-5cd12e9396b2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1370 microversion: 2.1 time: 0.172396 May 13 13:25:50.446518 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 186/378] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:50 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:50.821164 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-29507afd-2dae-4c4c-9b7e-4769bb2b474a tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:50.821777 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-29507afd-2dae-4c4c-9b7e-4769bb2b474a tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 7d22c736-3272-4f3c-950b-12fc33d878ba] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:50.828449 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-29507afd-2dae-4c4c-9b7e-4769bb2b474a tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:50.828895 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-29507afd-2dae-4c4c-9b7e-4769bb2b474a tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:50.829714 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-29507afd-2dae-4c4c-9b7e-4769bb2b474a tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:50.830189 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-29507afd-2dae-4c4c-9b7e-4769bb2b474a tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:50.893259 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-29507afd-2dae-4c4c-9b7e-4769bb2b474a tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:50.900402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-29507afd-2dae-4c4c-9b7e-4769bb2b474a tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba" status: 200 len: 1271 microversion: 2.1 time: 0.083122 May 13 13:25:50.900958 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 193/379] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:50 2022] GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:51.093878 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e859e4c7-6f9e-42e0-8787-f064877f9527 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:51.094534 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e859e4c7-6f9e-42e0-8787-f064877f9527 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:51.100905 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e859e4c7-6f9e-42e0-8787-f064877f9527 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:51.101355 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e859e4c7-6f9e-42e0-8787-f064877f9527 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:51.102129 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e859e4c7-6f9e-42e0-8787-f064877f9527 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:51.102631 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e859e4c7-6f9e-42e0-8787-f064877f9527 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:51.206857 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cad7894b-df5c-4d98-bb25-ba6d7f43f725 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:51.207652 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-cad7894b-df5c-4d98-bb25-ba6d7f43f725 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:51.213942 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cad7894b-df5c-4d98-bb25-ba6d7f43f725 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:51.214438 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cad7894b-df5c-4d98-bb25-ba6d7f43f725 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:51.215210 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cad7894b-df5c-4d98-bb25-ba6d7f43f725 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:51.216543 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cad7894b-df5c-4d98-bb25-ba6d7f43f725 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:51.246160 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e859e4c7-6f9e-42e0-8787-f064877f9527 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:51.255427 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e859e4c7-6f9e-42e0-8787-f064877f9527 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:51.256938 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e859e4c7-6f9e-42e0-8787-f064877f9527 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:51.258111 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e859e4c7-6f9e-42e0-8787-f064877f9527 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1726 microversion: 2.20 time: 0.168783 May 13 13:25:51.263096 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 187/380] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:51 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:51.275863 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-72de108e-dba5-4394-9005-55b685b4406d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "835d7358-d20e-463c-af16-eaf718c1c967"}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:51.277121 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-72de108e-dba5-4394-9005-55b685b4406d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:51.284222 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-72de108e-dba5-4394-9005-55b685b4406d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:51.284842 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-72de108e-dba5-4394-9005-55b685b4406d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:51.285549 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-72de108e-dba5-4394-9005-55b685b4406d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:51.286010 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-72de108e-dba5-4394-9005-55b685b4406d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:51.367402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-cad7894b-df5c-4d98-bb25-ba6d7f43f725 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:51.375771 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-cad7894b-df5c-4d98-bb25-ba6d7f43f725 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1708 microversion: 2.1 time: 0.173031 May 13 13:25:51.376469 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 194/381] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:51 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1708 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:51.463150 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-98f188c3-c7cf-42a6-9444-8545243f43fc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:51.463877 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-98f188c3-c7cf-42a6-9444-8545243f43fc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:51.470682 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-98f188c3-c7cf-42a6-9444-8545243f43fc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:51.471118 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-98f188c3-c7cf-42a6-9444-8545243f43fc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:51.471887 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-98f188c3-c7cf-42a6-9444-8545243f43fc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:51.472318 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-98f188c3-c7cf-42a6-9444-8545243f43fc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:51.611901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-98f188c3-c7cf-42a6-9444-8545243f43fc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:51.620180 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-98f188c3-c7cf-42a6-9444-8545243f43fc tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1370 microversion: 2.1 time: 0.161289 May 13 13:25:51.620758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 195/382] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:51 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:51.625579 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-d560d290-a230-4b28-85d5-45517d663c9f req-d31a0765-1bd1-46aa-9627-1fb759e7b509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6", "name": "network-vif-unplugged", "status": "completed", "tag": "c523458e-8e82-46df-bfae-db11fc8b2ec5"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:51.633944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-d560d290-a230-4b28-85d5-45517d663c9f req-d31a0765-1bd1-46aa-9627-1fb759e7b509 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:51.634449 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-d560d290-a230-4b28-85d5-45517d663c9f req-d31a0765-1bd1-46aa-9627-1fb759e7b509 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:51.646764 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-d560d290-a230-4b28-85d5-45517d663c9f req-d31a0765-1bd1-46aa-9627-1fb759e7b509 service nova] Creating event network-vif-unplugged:c523458e-8e82-46df-bfae-db11fc8b2ec5 for instance 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 on hv-cinder-84163 May 13 13:25:51.651676 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-d560d290-a230-4b28-85d5-45517d663c9f req-d31a0765-1bd1-46aa-9627-1fb759e7b509 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029788 May 13 13:25:51.652378 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 196/383] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:25:51.889885 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d2102cd0-4d26-4c39-9f0c-f31598eb756d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:51.890560 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d2102cd0-4d26-4c39-9f0c-f31598eb756d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:51.896467 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d2102cd0-4d26-4c39-9f0c-f31598eb756d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:51.896904 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d2102cd0-4d26-4c39-9f0c-f31598eb756d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:51.897652 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d2102cd0-4d26-4c39-9f0c-f31598eb756d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:51.898083 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d2102cd0-4d26-4c39-9f0c-f31598eb756d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:51.921337 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d2102cd0-4d26-4c39-9f0c-f31598eb756d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af/ips" status: 200 len: 149 microversion: 2.1 time: 0.036926 May 13 13:25:51.921919 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 197/384] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 13 13:25:51 2022] GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:25:51.926394 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d9385717-92a2-4529-b2f9-4d4502b58318 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:51.926998 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d9385717-92a2-4529-b2f9-4d4502b58318 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 7d22c736-3272-4f3c-950b-12fc33d878ba] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:51.932936 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d9385717-92a2-4529-b2f9-4d4502b58318 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:51.933384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d9385717-92a2-4529-b2f9-4d4502b58318 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:51.934726 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d9385717-92a2-4529-b2f9-4d4502b58318 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:51.935165 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d9385717-92a2-4529-b2f9-4d4502b58318 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:52.003323 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d9385717-92a2-4529-b2f9-4d4502b58318 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:52.014888 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d9385717-92a2-4529-b2f9-4d4502b58318 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba" status: 200 len: 1271 microversion: 2.1 time: 0.091338 May 13 13:25:52.016066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 198/385] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:51 2022] GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:52.393124 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ce54f1a2-58cd-49b2-82eb-c6695ef2d10d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:52.393729 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ce54f1a2-58cd-49b2-82eb-c6695ef2d10d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:52.399483 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ce54f1a2-58cd-49b2-82eb-c6695ef2d10d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:52.399927 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ce54f1a2-58cd-49b2-82eb-c6695ef2d10d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:52.400693 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ce54f1a2-58cd-49b2-82eb-c6695ef2d10d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:52.401124 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ce54f1a2-58cd-49b2-82eb-c6695ef2d10d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:52.409548 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-72de108e-dba5-4394-9005-55b685b4406d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "POST /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.137588 May 13 13:25:52.410450 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 188/386] 10.222.0.13 () {62 vars in 1363 bytes} [Fri May 13 13:25:51 2022] POST /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6/os-volume_attachments => generated 188 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 13:25:52.536060 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ce54f1a2-58cd-49b2-82eb-c6695ef2d10d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:52.538865 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-23ed9d11-19c8-4317-9b65-fb6789e19f45 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:52.538865 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-23ed9d11-19c8-4317-9b65-fb6789e19f45 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:52.548485 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ce54f1a2-58cd-49b2-82eb-c6695ef2d10d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1712 microversion: 2.1 time: 0.159056 May 13 13:25:52.549063 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 199/387] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:52 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1712 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:52.549281 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-23ed9d11-19c8-4317-9b65-fb6789e19f45 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:52.549717 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-23ed9d11-19c8-4317-9b65-fb6789e19f45 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:52.550723 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-23ed9d11-19c8-4317-9b65-fb6789e19f45 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:52.551163 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-23ed9d11-19c8-4317-9b65-fb6789e19f45 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:52.637552 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1172210c-3935-4eea-b5ca-e2ad2afc5a2c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:52.638143 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1172210c-3935-4eea-b5ca-e2ad2afc5a2c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:52.651591 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1172210c-3935-4eea-b5ca-e2ad2afc5a2c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:52.651591 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1172210c-3935-4eea-b5ca-e2ad2afc5a2c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:52.651591 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1172210c-3935-4eea-b5ca-e2ad2afc5a2c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:52.651591 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1172210c-3935-4eea-b5ca-e2ad2afc5a2c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:52.805215 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1172210c-3935-4eea-b5ca-e2ad2afc5a2c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:52.813368 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1172210c-3935-4eea-b5ca-e2ad2afc5a2c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1370 microversion: 2.1 time: 0.179593 May 13 13:25:52.814304 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 200/388] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:52 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:52.830887 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-23ed9d11-19c8-4317-9b65-fb6789e19f45 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "POST /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6/action" status: 202 len: 0 microversion: 2.20 time: 0.296551 May 13 13:25:52.832295 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 189/389] 10.222.0.13 () {62 vars in 1318 bytes} [Fri May 13 13:25:52 2022] POST /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 13 13:25:52.842171 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-04bceaa5-9ae2-4aec-976b-1e4df4fa9d66 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:52.842909 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-04bceaa5-9ae2-4aec-976b-1e4df4fa9d66 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:52.858596 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-04bceaa5-9ae2-4aec-976b-1e4df4fa9d66 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:52.858596 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-04bceaa5-9ae2-4aec-976b-1e4df4fa9d66 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:52.858596 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-04bceaa5-9ae2-4aec-976b-1e4df4fa9d66 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:52.858596 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-04bceaa5-9ae2-4aec-976b-1e4df4fa9d66 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:52.998957 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-04bceaa5-9ae2-4aec-976b-1e4df4fa9d66 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:53.008644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-04bceaa5-9ae2-4aec-976b-1e4df4fa9d66 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:53.013853 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-04bceaa5-9ae2-4aec-976b-1e4df4fa9d66 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:53.013853 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-04bceaa5-9ae2-4aec-976b-1e4df4fa9d66 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1752 microversion: 2.20 time: 0.174722 May 13 13:25:53.013853 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 201/390] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:52 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1752 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:25:53.032662 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-248fff71-d2b7-4ded-9b45-7eb8d333b39c tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:53.033266 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-248fff71-d2b7-4ded-9b45-7eb8d333b39c tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 7d22c736-3272-4f3c-950b-12fc33d878ba] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:53.040170 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-248fff71-d2b7-4ded-9b45-7eb8d333b39c tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:53.040170 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-248fff71-d2b7-4ded-9b45-7eb8d333b39c tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:53.040750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-248fff71-d2b7-4ded-9b45-7eb8d333b39c tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:53.041251 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-248fff71-d2b7-4ded-9b45-7eb8d333b39c tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:53.122716 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-248fff71-d2b7-4ded-9b45-7eb8d333b39c tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:53.132626 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-248fff71-d2b7-4ded-9b45-7eb8d333b39c tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba" status: 200 len: 1279 microversion: 2.1 time: 0.104552 May 13 13:25:53.133217 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 190/391] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:53 2022] GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba => generated 1279 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:53.774390 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ff9e2dbc-afd6-4ca3-96d2-128383d8ca71 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce90f542-eabc-4637-b1c3-de135c942909"}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:53.775519 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ff9e2dbc-afd6-4ca3-96d2-128383d8ca71 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:53.783612 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ff9e2dbc-afd6-4ca3-96d2-128383d8ca71 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:53.784556 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ff9e2dbc-afd6-4ca3-96d2-128383d8ca71 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:53.785142 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ff9e2dbc-afd6-4ca3-96d2-128383d8ca71 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:53.785539 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ff9e2dbc-afd6-4ca3-96d2-128383d8ca71 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:53.830800 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5de69cdd-54bf-48a8-a7da-4511f29d9fae tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:53.831563 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5de69cdd-54bf-48a8-a7da-4511f29d9fae tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:53.840591 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5de69cdd-54bf-48a8-a7da-4511f29d9fae tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:53.841305 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5de69cdd-54bf-48a8-a7da-4511f29d9fae tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:53.842190 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5de69cdd-54bf-48a8-a7da-4511f29d9fae tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:53.842953 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5de69cdd-54bf-48a8-a7da-4511f29d9fae tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:54.046040 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5de69cdd-54bf-48a8-a7da-4511f29d9fae tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:54.053987 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5de69cdd-54bf-48a8-a7da-4511f29d9fae tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1564 microversion: 2.1 time: 0.227042 May 13 13:25:54.054710 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 191/392] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:53 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1564 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:54.062117 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-fd2673d7-839a-4ae2-8308-254c6b06671b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:54.062888 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-fd2673d7-839a-4ae2-8308-254c6b06671b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:54.069608 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd2673d7-839a-4ae2-8308-254c6b06671b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:54.070060 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd2673d7-839a-4ae2-8308-254c6b06671b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:54.076733 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd2673d7-839a-4ae2-8308-254c6b06671b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:54.077460 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd2673d7-839a-4ae2-8308-254c6b06671b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:54.235879 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fd2673d7-839a-4ae2-8308-254c6b06671b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:54.244602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fd2673d7-839a-4ae2-8308-254c6b06671b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:54.246182 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fd2673d7-839a-4ae2-8308-254c6b06671b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:54.248622 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-fd2673d7-839a-4ae2-8308-254c6b06671b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1752 microversion: 2.20 time: 0.192056 May 13 13:25:54.249212 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 192/393] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:54 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1752 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:54.253870 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-825ddc1f-2c8b-4684-8dba-884bfaea4a00 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:54.254387 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-825ddc1f-2c8b-4684-8dba-884bfaea4a00 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:54.260870 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-825ddc1f-2c8b-4684-8dba-884bfaea4a00 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:54.261311 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-825ddc1f-2c8b-4684-8dba-884bfaea4a00 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:54.262986 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-825ddc1f-2c8b-4684-8dba-884bfaea4a00 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:54.264034 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-825ddc1f-2c8b-4684-8dba-884bfaea4a00 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:54.355277 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-825ddc1f-2c8b-4684-8dba-884bfaea4a00 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104991 May 13 13:25:54.355983 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 193/394] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 13 13:25:54 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:25:54.361407 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-51b5ed1a-373a-4d41-a3a7-3d61d6309af3 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:54.361407 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-51b5ed1a-373a-4d41-a3a7-3d61d6309af3 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 7d22c736-3272-4f3c-950b-12fc33d878ba] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:54.367587 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-51b5ed1a-373a-4d41-a3a7-3d61d6309af3 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:54.368228 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-51b5ed1a-373a-4d41-a3a7-3d61d6309af3 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:54.369091 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-51b5ed1a-373a-4d41-a3a7-3d61d6309af3 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:54.370156 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-51b5ed1a-373a-4d41-a3a7-3d61d6309af3 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:54.663589 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ff9e2dbc-afd6-4ca3-96d2-128383d8ca71 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "POST /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.893032 May 13 13:25:54.664893 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 202/395] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 13 13:25:53 2022] POST /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af/os-volume_attachments => generated 194 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:25:54.672127 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-51fb5e01-7a23-4c73-a901-b5b8c810b2ab req-712bb063-82ff-48b1-b194-27b8e24dc731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d22c736-3272-4f3c-950b-12fc33d878ba", "tag": "0299a732-f26e-4354-82c8-4c45974d6071"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:54.683117 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-51fb5e01-7a23-4c73-a901-b5b8c810b2ab req-712bb063-82ff-48b1-b194-27b8e24dc731 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:54.683546 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-51fb5e01-7a23-4c73-a901-b5b8c810b2ab req-712bb063-82ff-48b1-b194-27b8e24dc731 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:54.719266 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-51fb5e01-7a23-4c73-a901-b5b8c810b2ab req-712bb063-82ff-48b1-b194-27b8e24dc731 service nova] Creating event network-changed:0299a732-f26e-4354-82c8-4c45974d6071 for instance 7d22c736-3272-4f3c-950b-12fc33d878ba on hv-cinder-84163 May 13 13:25:54.742332 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-51fb5e01-7a23-4c73-a901-b5b8c810b2ab req-712bb063-82ff-48b1-b194-27b8e24dc731 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075842 May 13 13:25:54.743272 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 203/396] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:25:54.884889 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-51b5ed1a-373a-4d41-a3a7-3d61d6309af3 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:54.889145 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-51b5ed1a-373a-4d41-a3a7-3d61d6309af3 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba" status: 200 len: 1319 microversion: 2.1 time: 0.532084 May 13 13:25:54.890067 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 194/397] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:54 2022] GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba => generated 1319 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:55.269478 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e5987d9f-9103-4d5e-a220-9b1451ad0288 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:55.270167 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e5987d9f-9103-4d5e-a220-9b1451ad0288 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:55.277037 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e5987d9f-9103-4d5e-a220-9b1451ad0288 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:55.277484 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e5987d9f-9103-4d5e-a220-9b1451ad0288 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:55.278940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e5987d9f-9103-4d5e-a220-9b1451ad0288 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:55.279354 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e5987d9f-9103-4d5e-a220-9b1451ad0288 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:55.506914 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e5987d9f-9103-4d5e-a220-9b1451ad0288 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:55.523954 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e5987d9f-9103-4d5e-a220-9b1451ad0288 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:55.526628 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e5987d9f-9103-4d5e-a220-9b1451ad0288 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:55.529702 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e5987d9f-9103-4d5e-a220-9b1451ad0288 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1754 microversion: 2.20 time: 0.264556 May 13 13:25:55.530751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 204/398] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:55 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1754 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:55.836169 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-f507b07c-6e8b-4f98-832b-cb879ea4629c req-72d1d355-bfc5-413c-80e0-6ae82d93c13f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba162312-5c53-4320-acc9-4e2566f27686", "tag": "bc491e34-66dc-4f6f-9292-c68b5d9c9928"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:55.845460 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-f507b07c-6e8b-4f98-832b-cb879ea4629c req-72d1d355-bfc5-413c-80e0-6ae82d93c13f service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:55.847248 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-f507b07c-6e8b-4f98-832b-cb879ea4629c req-72d1d355-bfc5-413c-80e0-6ae82d93c13f service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:55.858084 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-f507b07c-6e8b-4f98-832b-cb879ea4629c req-72d1d355-bfc5-413c-80e0-6ae82d93c13f service nova] Creating event network-changed:bc491e34-66dc-4f6f-9292-c68b5d9c9928 for instance ba162312-5c53-4320-acc9-4e2566f27686 on hv-cinder-84163 May 13 13:25:55.863430 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-f507b07c-6e8b-4f98-832b-cb879ea4629c req-72d1d355-bfc5-413c-80e0-6ae82d93c13f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031279 May 13 13:25:55.864115 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 195/399] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:25:55.907403 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-9f15c9c8-1b1a-4bdd-a8a7-690877feb77e tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:55.908102 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-9f15c9c8-1b1a-4bdd-a8a7-690877feb77e tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 7d22c736-3272-4f3c-950b-12fc33d878ba] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:55.914340 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9f15c9c8-1b1a-4bdd-a8a7-690877feb77e tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:55.914865 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9f15c9c8-1b1a-4bdd-a8a7-690877feb77e tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:55.915734 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9f15c9c8-1b1a-4bdd-a8a7-690877feb77e tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:55.916236 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9f15c9c8-1b1a-4bdd-a8a7-690877feb77e tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:56.060512 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-9f15c9c8-1b1a-4bdd-a8a7-690877feb77e tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:56.067753 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-9f15c9c8-1b1a-4bdd-a8a7-690877feb77e tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba" status: 200 len: 1319 microversion: 2.1 time: 0.164963 May 13 13:25:56.068538 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 205/400] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:55 2022] GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:56.550579 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-08e714d1-c686-4dbe-8624-a897aa8db7a4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:56.552226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-08e714d1-c686-4dbe-8624-a897aa8db7a4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:56.558939 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-08e714d1-c686-4dbe-8624-a897aa8db7a4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:56.559639 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-08e714d1-c686-4dbe-8624-a897aa8db7a4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:56.560741 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-08e714d1-c686-4dbe-8624-a897aa8db7a4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:56.561322 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-08e714d1-c686-4dbe-8624-a897aa8db7a4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:56.719288 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-08e714d1-c686-4dbe-8624-a897aa8db7a4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:56.727969 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-08e714d1-c686-4dbe-8624-a897aa8db7a4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:56.729505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-08e714d1-c686-4dbe-8624-a897aa8db7a4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:56.730704 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-08e714d1-c686-4dbe-8624-a897aa8db7a4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1754 microversion: 2.20 time: 0.184906 May 13 13:25:56.732952 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 196/401] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:56 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1754 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:57.085006 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-502c052d-9b85-40e7-8e8f-615afa7c3d4d tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:57.085647 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-502c052d-9b85-40e7-8e8f-615afa7c3d4d tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 7d22c736-3272-4f3c-950b-12fc33d878ba] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:57.093190 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-502c052d-9b85-40e7-8e8f-615afa7c3d4d tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:57.093636 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-502c052d-9b85-40e7-8e8f-615afa7c3d4d tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:57.094686 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-502c052d-9b85-40e7-8e8f-615afa7c3d4d tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:57.095127 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-502c052d-9b85-40e7-8e8f-615afa7c3d4d tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:57.236691 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-502c052d-9b85-40e7-8e8f-615afa7c3d4d tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:57.244359 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-502c052d-9b85-40e7-8e8f-615afa7c3d4d tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba" status: 200 len: 1319 microversion: 2.1 time: 0.163463 May 13 13:25:57.244935 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 206/402] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:57 2022] GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:57.748892 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2ec1b0ac-9b6a-47d1-b2c4-02bf255a5a9b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:57.749412 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2ec1b0ac-9b6a-47d1-b2c4-02bf255a5a9b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:57.755887 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2ec1b0ac-9b6a-47d1-b2c4-02bf255a5a9b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:57.756325 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2ec1b0ac-9b6a-47d1-b2c4-02bf255a5a9b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:57.757085 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2ec1b0ac-9b6a-47d1-b2c4-02bf255a5a9b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:57.757515 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2ec1b0ac-9b6a-47d1-b2c4-02bf255a5a9b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:57.894939 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2ec1b0ac-9b6a-47d1-b2c4-02bf255a5a9b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:57.904225 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2ec1b0ac-9b6a-47d1-b2c4-02bf255a5a9b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:57.905729 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2ec1b0ac-9b6a-47d1-b2c4-02bf255a5a9b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:57.906921 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2ec1b0ac-9b6a-47d1-b2c4-02bf255a5a9b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1754 microversion: 2.20 time: 0.162002 May 13 13:25:57.907507 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 197/403] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:57 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:58.260995 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-287ad607-a64f-452d-a414-0913e49ffaf4 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:58.261683 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-287ad607-a64f-452d-a414-0913e49ffaf4 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 7d22c736-3272-4f3c-950b-12fc33d878ba] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:58.268114 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-287ad607-a64f-452d-a414-0913e49ffaf4 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:58.268673 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-287ad607-a64f-452d-a414-0913e49ffaf4 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:58.269436 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-287ad607-a64f-452d-a414-0913e49ffaf4 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:58.269861 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-287ad607-a64f-452d-a414-0913e49ffaf4 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:58.408001 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-287ad607-a64f-452d-a414-0913e49ffaf4 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:58.415508 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-287ad607-a64f-452d-a414-0913e49ffaf4 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba" status: 200 len: 1319 microversion: 2.1 time: 0.158268 May 13 13:25:58.416082 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 207/404] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:58 2022] GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:58.926147 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-080fced8-b1f1-492e-8a70-38af694e32fe tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:58.928428 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-080fced8-b1f1-492e-8a70-38af694e32fe tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:58.933288 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-080fced8-b1f1-492e-8a70-38af694e32fe tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:58.933982 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-080fced8-b1f1-492e-8a70-38af694e32fe tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:58.935239 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-080fced8-b1f1-492e-8a70-38af694e32fe tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:58.935839 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-080fced8-b1f1-492e-8a70-38af694e32fe tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:59.077887 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-080fced8-b1f1-492e-8a70-38af694e32fe tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:59.086561 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-080fced8-b1f1-492e-8a70-38af694e32fe tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:59.088849 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-080fced8-b1f1-492e-8a70-38af694e32fe tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:59.091111 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-080fced8-b1f1-492e-8a70-38af694e32fe tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1754 microversion: 2.20 time: 0.168293 May 13 13:25:59.091692 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 198/405] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:25:58 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:59.432742 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1b00bfd1-e36c-4642-91e9-de6d6a7df4bb tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:59.433348 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1b00bfd1-e36c-4642-91e9-de6d6a7df4bb tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 7d22c736-3272-4f3c-950b-12fc33d878ba] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:59.440513 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-85f8fcde-79e5-4080-94de-f95813fa22de req-fe4bcbcf-cf50-4090-871d-bd3aae93ec1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d22c736-3272-4f3c-950b-12fc33d878ba", "name": "network-vif-plugged", "status": "completed", "tag": "0299a732-f26e-4354-82c8-4c45974d6071"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:59.440927 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1b00bfd1-e36c-4642-91e9-de6d6a7df4bb tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:59.441668 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1b00bfd1-e36c-4642-91e9-de6d6a7df4bb tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:59.443033 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1b00bfd1-e36c-4642-91e9-de6d6a7df4bb tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:59.443033 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1b00bfd1-e36c-4642-91e9-de6d6a7df4bb tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:59.449322 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-85f8fcde-79e5-4080-94de-f95813fa22de req-fe4bcbcf-cf50-4090-871d-bd3aae93ec1b service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:59.450508 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-85f8fcde-79e5-4080-94de-f95813fa22de req-fe4bcbcf-cf50-4090-871d-bd3aae93ec1b service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:59.462274 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-85f8fcde-79e5-4080-94de-f95813fa22de req-fe4bcbcf-cf50-4090-871d-bd3aae93ec1b service nova] Creating event network-vif-plugged:0299a732-f26e-4354-82c8-4c45974d6071 for instance 7d22c736-3272-4f3c-950b-12fc33d878ba on hv-cinder-84163 May 13 13:25:59.467535 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-85f8fcde-79e5-4080-94de-f95813fa22de req-fe4bcbcf-cf50-4090-871d-bd3aae93ec1b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030719 May 13 13:25:59.468154 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 199/406] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:25:59.585815 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1b00bfd1-e36c-4642-91e9-de6d6a7df4bb tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:59.593814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1b00bfd1-e36c-4642-91e9-de6d6a7df4bb tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba" status: 200 len: 1319 microversion: 2.1 time: 0.164807 May 13 13:25:59.596086 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 208/407] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:25:59 2022] GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:00.110743 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-24a96bb1-54fb-4cb0-b996-d15ee67bc40a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:00.111548 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-24a96bb1-54fb-4cb0-b996-d15ee67bc40a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:00.117923 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-24a96bb1-54fb-4cb0-b996-d15ee67bc40a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:00.118404 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-24a96bb1-54fb-4cb0-b996-d15ee67bc40a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:00.119182 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-24a96bb1-54fb-4cb0-b996-d15ee67bc40a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:00.119618 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-24a96bb1-54fb-4cb0-b996-d15ee67bc40a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:00.253475 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-24a96bb1-54fb-4cb0-b996-d15ee67bc40a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:00.261829 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-24a96bb1-54fb-4cb0-b996-d15ee67bc40a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:00.263698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-24a96bb1-54fb-4cb0-b996-d15ee67bc40a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:00.264879 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-24a96bb1-54fb-4cb0-b996-d15ee67bc40a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1754 microversion: 2.20 time: 0.159559 May 13 13:26:00.265439 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 200/408] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:00 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:00.610979 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-139b084b-5b1d-4c9f-9172-15ac72b4dd22 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:00.611592 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-139b084b-5b1d-4c9f-9172-15ac72b4dd22 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 7d22c736-3272-4f3c-950b-12fc33d878ba] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:00.618291 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-139b084b-5b1d-4c9f-9172-15ac72b4dd22 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:00.618736 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-139b084b-5b1d-4c9f-9172-15ac72b4dd22 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:00.619509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-139b084b-5b1d-4c9f-9172-15ac72b4dd22 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:00.619965 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-139b084b-5b1d-4c9f-9172-15ac72b4dd22 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:00.753666 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-139b084b-5b1d-4c9f-9172-15ac72b4dd22 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:00.761041 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-139b084b-5b1d-4c9f-9172-15ac72b4dd22 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba" status: 200 len: 1319 microversion: 2.1 time: 0.154053 May 13 13:26:00.761610 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 209/409] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:00 2022] GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:01.283307 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-dfe39af1-91e5-4b92-81d6-94b5c5ebc39b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:01.283917 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-dfe39af1-91e5-4b92-81d6-94b5c5ebc39b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:01.290386 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dfe39af1-91e5-4b92-81d6-94b5c5ebc39b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:01.290834 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dfe39af1-91e5-4b92-81d6-94b5c5ebc39b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:01.291601 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dfe39af1-91e5-4b92-81d6-94b5c5ebc39b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:01.292042 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dfe39af1-91e5-4b92-81d6-94b5c5ebc39b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:01.427150 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dfe39af1-91e5-4b92-81d6-94b5c5ebc39b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:01.437312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dfe39af1-91e5-4b92-81d6-94b5c5ebc39b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:01.438876 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dfe39af1-91e5-4b92-81d6-94b5c5ebc39b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:01.440042 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-dfe39af1-91e5-4b92-81d6-94b5c5ebc39b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1754 microversion: 2.20 time: 0.160643 May 13 13:26:01.440642 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 201/410] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:01 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:01.779513 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2854e7a9-390e-4e64-9e90-11048e2cbfb7 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:01.780060 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2854e7a9-390e-4e64-9e90-11048e2cbfb7 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 7d22c736-3272-4f3c-950b-12fc33d878ba] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:01.787001 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2854e7a9-390e-4e64-9e90-11048e2cbfb7 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:01.787445 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2854e7a9-390e-4e64-9e90-11048e2cbfb7 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:01.788207 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2854e7a9-390e-4e64-9e90-11048e2cbfb7 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:01.788674 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2854e7a9-390e-4e64-9e90-11048e2cbfb7 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:01.932319 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2854e7a9-390e-4e64-9e90-11048e2cbfb7 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:01.937802 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2854e7a9-390e-4e64-9e90-11048e2cbfb7 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba" status: 200 len: 1505 microversion: 2.1 time: 0.163080 May 13 13:26:01.938403 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 210/411] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:01 2022] GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:01.955188 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1ceec399-a8ba-4249-87c7-81e218515867 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cfe3157-3bc2-414e-b517-72c1b151e7d4", "device": "/dev/sdb"}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:26:01.956277 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1ceec399-a8ba-4249-87c7-81e218515867 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 7d22c736-3272-4f3c-950b-12fc33d878ba] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:01.962650 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1ceec399-a8ba-4249-87c7-81e218515867 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:01.963098 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1ceec399-a8ba-4249-87c7-81e218515867 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:01.963884 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1ceec399-a8ba-4249-87c7-81e218515867 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:01.964323 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1ceec399-a8ba-4249-87c7-81e218515867 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:02.459261 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f2fc5b75-9a31-41a9-a8af-c20a0c15a87c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:02.459863 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f2fc5b75-9a31-41a9-a8af-c20a0c15a87c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:02.466734 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f2fc5b75-9a31-41a9-a8af-c20a0c15a87c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:02.467238 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f2fc5b75-9a31-41a9-a8af-c20a0c15a87c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:02.468918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f2fc5b75-9a31-41a9-a8af-c20a0c15a87c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:02.468918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f2fc5b75-9a31-41a9-a8af-c20a0c15a87c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:02.623104 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f2fc5b75-9a31-41a9-a8af-c20a0c15a87c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:02.646085 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f2fc5b75-9a31-41a9-a8af-c20a0c15a87c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:02.646085 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f2fc5b75-9a31-41a9-a8af-c20a0c15a87c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:02.646085 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f2fc5b75-9a31-41a9-a8af-c20a0c15a87c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1754 microversion: 2.20 time: 0.180779 May 13 13:26:02.646677 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 211/412] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:02 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1754 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:26:03.280076 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a086bcff-808e-4958-96a5-d547a76500a7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Action: 'create', calling method: .version_select at 0x7fb084a844c0>, body: {"keypair": {"name": "tempest-keypair-1147882846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH83TwsCoV1HsjDGC9wzq0a3JnCrtzr8AtLwYTCg4UPegXBR7Bh3t4z2B+VreZliUOydARlCciZCpNo3txSYC0rRGbRvXNVB8aZ9fTQIAJByGx0F4onwFyxWhzGKhoDOPA=="}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:26:03.303001 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-a086bcff-808e-4958-96a5-d547a76500a7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Getting quotas for project 2c900748e271404bb3cb11fb2308e784. Resources: {'key_pairs'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:26:03.306819 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-a086bcff-808e-4958-96a5-d547a76500a7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Getting quotas for user e25df7c837584b19afe274f6edfb8efd and project 2c900748e271404bb3cb11fb2308e784. Resources: {'key_pairs'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:26:03.319209 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1ceec399-a8ba-4249-87c7-81e218515867 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "POST /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.367796 May 13 13:26:03.320122 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 202/413] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 13 13:26:01 2022] POST /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba/os-volume_attachments => generated 194 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:26:03.491569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a086bcff-808e-4958-96a5-d547a76500a7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.216189 May 13 13:26:03.492090 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 212/414] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 13 13:26:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:26:03.657601 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b7d1bfab-498b-4326-a65d-13bf0d010abc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:03.659399 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b7d1bfab-498b-4326-a65d-13bf0d010abc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:03.665813 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b7d1bfab-498b-4326-a65d-13bf0d010abc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:03.666283 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b7d1bfab-498b-4326-a65d-13bf0d010abc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:03.667239 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b7d1bfab-498b-4326-a65d-13bf0d010abc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:03.667677 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b7d1bfab-498b-4326-a65d-13bf0d010abc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:03.958750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b7d1bfab-498b-4326-a65d-13bf0d010abc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:03.958750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b7d1bfab-498b-4326-a65d-13bf0d010abc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:03.959447 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b7d1bfab-498b-4326-a65d-13bf0d010abc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:03.959447 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b7d1bfab-498b-4326-a65d-13bf0d010abc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1754 microversion: 2.20 time: 0.169579 May 13 13:26:03.959447 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 203/415] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:03 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:04.968007 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3daea814-37af-4fbd-a5a2-e4fa8cf885e7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:04.968645 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3daea814-37af-4fbd-a5a2-e4fa8cf885e7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:04.975086 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3daea814-37af-4fbd-a5a2-e4fa8cf885e7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:04.975601 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3daea814-37af-4fbd-a5a2-e4fa8cf885e7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:04.976380 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3daea814-37af-4fbd-a5a2-e4fa8cf885e7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:04.976845 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3daea814-37af-4fbd-a5a2-e4fa8cf885e7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:05.140215 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3daea814-37af-4fbd-a5a2-e4fa8cf885e7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:05.148841 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3daea814-37af-4fbd-a5a2-e4fa8cf885e7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:05.150484 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3daea814-37af-4fbd-a5a2-e4fa8cf885e7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:05.151626 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3daea814-37af-4fbd-a5a2-e4fa8cf885e7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1810 microversion: 2.20 time: 0.189028 May 13 13:26:05.152187 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 213/416] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:04 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1810 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:06.171693 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-031bc4e6-2f11-49fd-b15f-8158f32cbee9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:06.172313 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-031bc4e6-2f11-49fd-b15f-8158f32cbee9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:06.181268 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-031bc4e6-2f11-49fd-b15f-8158f32cbee9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:06.181268 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-031bc4e6-2f11-49fd-b15f-8158f32cbee9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:06.182178 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-031bc4e6-2f11-49fd-b15f-8158f32cbee9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:06.182759 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-031bc4e6-2f11-49fd-b15f-8158f32cbee9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:06.374917 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-031bc4e6-2f11-49fd-b15f-8158f32cbee9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:06.383279 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-031bc4e6-2f11-49fd-b15f-8158f32cbee9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:06.384862 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-031bc4e6-2f11-49fd-b15f-8158f32cbee9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:06.386140 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-031bc4e6-2f11-49fd-b15f-8158f32cbee9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1810 microversion: 2.20 time: 0.219207 May 13 13:26:06.386952 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 204/417] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:06 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1810 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:06.532079 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ca686163-f5cc-4dbd-a7d5-05223937a22f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1917714951", "imageRef": "ece294e8-5415-4d6a-a0d3-a14539c51c0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc71e07c-eb5e-4e51-82e1-4253b2766878"}], "security_groups": [{"name": "tempest-securitygroup--1013813009"}], "key_name": "tempest-keypair-1147882846", "user_data": "}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:26:06.643433 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.network.neutron [None req-ca686163-f5cc-4dbd-a7d5-05223937a22f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] validate_networks() for [('fc71e07c-eb5e-4e51-82e1-4253b2766878', None, None, None, None, None)] {{(pid=117721) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:26:07.032049 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-ca686163-f5cc-4dbd-a7d5-05223937a22f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Flavor limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:26:07.032585 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-ca686163-f5cc-4dbd-a7d5-05223937a22f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Image limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:26:07.033181 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-ca686163-f5cc-4dbd-a7d5-05223937a22f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Flavor pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:26:07.033688 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-ca686163-f5cc-4dbd-a7d5-05223937a22f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Image pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:26:07.034446 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-ca686163-f5cc-4dbd-a7d5-05223937a22f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:26:07.052200 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ca686163-f5cc-4dbd-a7d5-05223937a22f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:07.052936 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ca686163-f5cc-4dbd-a7d5-05223937a22f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:07.053945 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ca686163-f5cc-4dbd-a7d5-05223937a22f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:07.054748 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ca686163-f5cc-4dbd-a7d5-05223937a22f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:07.077028 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-ca686163-f5cc-4dbd-a7d5-05223937a22f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Getting quotas for project 2c900748e271404bb3cb11fb2308e784. Resources: {'cores', 'instances', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:26:07.081600 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-ca686163-f5cc-4dbd-a7d5-05223937a22f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Getting quotas for user e25df7c837584b19afe274f6edfb8efd and project 2c900748e271404bb3cb11fb2308e784. Resources: {'cores', 'instances', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:26:07.102025 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ca686163-f5cc-4dbd-a7d5-05223937a22f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Going to run 1 instances... {{(pid=117721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:26:07.105214 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ca686163-f5cc-4dbd-a7d5-05223937a22f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ece294e8-5415-4d6a-a0d3-a14539c51c0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:26:07.216738 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ca686163-f5cc-4dbd-a7d5-05223937a22f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.693641 May 13 13:26:07.218005 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 214/418] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 13 13:26:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:26:07.236224 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e2ca9deb-c395-4bf2-90f2-90bc66c91bae tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:07.236954 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e2ca9deb-c395-4bf2-90f2-90bc66c91bae tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:07.305170 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e2ca9deb-c395-4bf2-90f2-90bc66c91bae tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:07.314402 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e2ca9deb-c395-4bf2-90f2-90bc66c91bae tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1242 microversion: 2.1 time: 0.089241 May 13 13:26:07.320821 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 205/419] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:07 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:07.404975 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6ef9d2c7-f787-405f-9065-5a82eed56187 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:07.405632 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6ef9d2c7-f787-405f-9065-5a82eed56187 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:07.412918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6ef9d2c7-f787-405f-9065-5a82eed56187 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:07.413570 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6ef9d2c7-f787-405f-9065-5a82eed56187 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:07.414593 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6ef9d2c7-f787-405f-9065-5a82eed56187 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:07.415205 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6ef9d2c7-f787-405f-9065-5a82eed56187 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:07.568083 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6ef9d2c7-f787-405f-9065-5a82eed56187 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:07.577993 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6ef9d2c7-f787-405f-9065-5a82eed56187 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:07.579640 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6ef9d2c7-f787-405f-9065-5a82eed56187 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:07.581068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6ef9d2c7-f787-405f-9065-5a82eed56187 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1810 microversion: 2.20 time: 0.180408 May 13 13:26:07.581626 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 215/420] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:07 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:08.330825 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5ddaf328-7c24-4656-8600-4d040baa938d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:08.331603 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5ddaf328-7c24-4656-8600-4d040baa938d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:08.339440 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5ddaf328-7c24-4656-8600-4d040baa938d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:08.340570 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5ddaf328-7c24-4656-8600-4d040baa938d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:08.341379 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5ddaf328-7c24-4656-8600-4d040baa938d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:08.341819 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5ddaf328-7c24-4656-8600-4d040baa938d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:08.409415 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5ddaf328-7c24-4656-8600-4d040baa938d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:08.418046 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5ddaf328-7c24-4656-8600-4d040baa938d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1246 microversion: 2.1 time: 0.090929 May 13 13:26:08.419946 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 206/421] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:08 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1246 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:08.601550 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c1589d91-3858-43b1-af7d-b44e796d52c1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:08.602151 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c1589d91-3858-43b1-af7d-b44e796d52c1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:08.609581 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c1589d91-3858-43b1-af7d-b44e796d52c1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:08.610023 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c1589d91-3858-43b1-af7d-b44e796d52c1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:08.610817 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c1589d91-3858-43b1-af7d-b44e796d52c1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:08.611244 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c1589d91-3858-43b1-af7d-b44e796d52c1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:08.770364 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c1589d91-3858-43b1-af7d-b44e796d52c1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:08.777062 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c1589d91-3858-43b1-af7d-b44e796d52c1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:08.780276 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c1589d91-3858-43b1-af7d-b44e796d52c1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:08.780789 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c1589d91-3858-43b1-af7d-b44e796d52c1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1810 microversion: 2.20 time: 0.184108 May 13 13:26:08.781387 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 216/422] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:08 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1810 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:26:09.436219 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5d27ad1e-093d-4f47-ad06-3b94c43de471 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:09.436838 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5d27ad1e-093d-4f47-ad06-3b94c43de471 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:09.443479 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5d27ad1e-093d-4f47-ad06-3b94c43de471 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:09.443924 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5d27ad1e-093d-4f47-ad06-3b94c43de471 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:09.444707 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5d27ad1e-093d-4f47-ad06-3b94c43de471 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:09.445144 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5d27ad1e-093d-4f47-ad06-3b94c43de471 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:09.515848 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5d27ad1e-093d-4f47-ad06-3b94c43de471 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:09.524421 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5d27ad1e-093d-4f47-ad06-3b94c43de471 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1246 microversion: 2.1 time: 0.092498 May 13 13:26:09.525883 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 207/423] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:09 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1246 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:09.800053 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-611d4ed2-1a75-4829-80db-05e6d391014c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:09.800654 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-611d4ed2-1a75-4829-80db-05e6d391014c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:09.810121 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-611d4ed2-1a75-4829-80db-05e6d391014c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:09.810624 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-611d4ed2-1a75-4829-80db-05e6d391014c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:09.811426 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-611d4ed2-1a75-4829-80db-05e6d391014c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:09.811865 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-611d4ed2-1a75-4829-80db-05e6d391014c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:09.974027 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-611d4ed2-1a75-4829-80db-05e6d391014c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:09.984096 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-611d4ed2-1a75-4829-80db-05e6d391014c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:09.985968 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-611d4ed2-1a75-4829-80db-05e6d391014c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:09.987256 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-611d4ed2-1a75-4829-80db-05e6d391014c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1810 microversion: 2.20 time: 0.191338 May 13 13:26:09.988138 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 217/424] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:09 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1810 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:10.541286 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6324f232-2097-44c3-a745-034a7f1997c0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:10.541873 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6324f232-2097-44c3-a745-034a7f1997c0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:10.549297 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6324f232-2097-44c3-a745-034a7f1997c0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:10.549752 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6324f232-2097-44c3-a745-034a7f1997c0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:10.550715 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6324f232-2097-44c3-a745-034a7f1997c0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:10.551192 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6324f232-2097-44c3-a745-034a7f1997c0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:10.619615 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6324f232-2097-44c3-a745-034a7f1997c0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:10.629895 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6324f232-2097-44c3-a745-034a7f1997c0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1246 microversion: 2.1 time: 0.092618 May 13 13:26:10.631487 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 208/425] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:10 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1246 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:11.005757 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-bb9c9af0-3f9b-4711-9730-7a14feec030f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:11.006719 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-bb9c9af0-3f9b-4711-9730-7a14feec030f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:11.014827 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bb9c9af0-3f9b-4711-9730-7a14feec030f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:11.015274 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bb9c9af0-3f9b-4711-9730-7a14feec030f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:11.016053 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bb9c9af0-3f9b-4711-9730-7a14feec030f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:11.016517 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bb9c9af0-3f9b-4711-9730-7a14feec030f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:11.174267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-bb9c9af0-3f9b-4711-9730-7a14feec030f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:11.185952 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-bb9c9af0-3f9b-4711-9730-7a14feec030f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:11.187506 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-bb9c9af0-3f9b-4711-9730-7a14feec030f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:11.190259 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-bb9c9af0-3f9b-4711-9730-7a14feec030f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1810 microversion: 2.20 time: 0.188252 May 13 13:26:11.205473 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 218/426] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:11 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1810 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:11.649447 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-82aa9e99-cc51-4b88-8267-c2a777329d56 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:11.650112 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-82aa9e99-cc51-4b88-8267-c2a777329d56 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:11.657163 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-82aa9e99-cc51-4b88-8267-c2a777329d56 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:11.657649 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-82aa9e99-cc51-4b88-8267-c2a777329d56 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:11.658458 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-82aa9e99-cc51-4b88-8267-c2a777329d56 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:11.658911 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-82aa9e99-cc51-4b88-8267-c2a777329d56 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:11.725048 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-82aa9e99-cc51-4b88-8267-c2a777329d56 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:11.734387 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-82aa9e99-cc51-4b88-8267-c2a777329d56 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1246 microversion: 2.1 time: 0.089051 May 13 13:26:11.744408 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 209/427] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:11 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:12.209156 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-31187382-9583-453e-a0d2-695d1c841ac7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:12.210538 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-31187382-9583-453e-a0d2-695d1c841ac7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:12.220718 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-31187382-9583-453e-a0d2-695d1c841ac7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:12.221924 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-31187382-9583-453e-a0d2-695d1c841ac7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:12.223572 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-31187382-9583-453e-a0d2-695d1c841ac7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:12.224690 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-31187382-9583-453e-a0d2-695d1c841ac7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:12.381833 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-31187382-9583-453e-a0d2-695d1c841ac7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:12.393661 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-31187382-9583-453e-a0d2-695d1c841ac7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:12.397513 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-31187382-9583-453e-a0d2-695d1c841ac7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:12.397513 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-31187382-9583-453e-a0d2-695d1c841ac7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1810 microversion: 2.20 time: 0.191526 May 13 13:26:12.403382 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 219/428] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:12 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1810 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:12.752602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1b68538e-e405-4e6b-b895-6a0568fa9a84 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:12.753829 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1b68538e-e405-4e6b-b895-6a0568fa9a84 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:12.760754 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1b68538e-e405-4e6b-b895-6a0568fa9a84 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:12.761206 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1b68538e-e405-4e6b-b895-6a0568fa9a84 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:12.762623 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1b68538e-e405-4e6b-b895-6a0568fa9a84 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:12.763798 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1b68538e-e405-4e6b-b895-6a0568fa9a84 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:12.833519 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1b68538e-e405-4e6b-b895-6a0568fa9a84 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:12.843121 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1b68538e-e405-4e6b-b895-6a0568fa9a84 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1246 microversion: 2.1 time: 0.094182 May 13 13:26:12.843707 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 210/429] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:12 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1246 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:13.415745 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-850a11cd-445c-4a7a-9aa5-d2079d0b6886 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:13.416352 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-850a11cd-445c-4a7a-9aa5-d2079d0b6886 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:13.423378 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-850a11cd-445c-4a7a-9aa5-d2079d0b6886 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:13.423820 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-850a11cd-445c-4a7a-9aa5-d2079d0b6886 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:13.424658 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-850a11cd-445c-4a7a-9aa5-d2079d0b6886 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:13.425025 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-850a11cd-445c-4a7a-9aa5-d2079d0b6886 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:13.563792 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-850a11cd-445c-4a7a-9aa5-d2079d0b6886 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:13.573509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-850a11cd-445c-4a7a-9aa5-d2079d0b6886 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:13.575317 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-850a11cd-445c-4a7a-9aa5-d2079d0b6886 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:13.576812 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-850a11cd-445c-4a7a-9aa5-d2079d0b6886 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1810 microversion: 2.20 time: 0.165069 May 13 13:26:13.577449 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 220/430] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:13 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:13.866011 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-34d5e41b-2f7a-4058-aed6-37d12bf1fade tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:13.867969 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-34d5e41b-2f7a-4058-aed6-37d12bf1fade tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:13.880489 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34d5e41b-2f7a-4058-aed6-37d12bf1fade tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:13.881226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34d5e41b-2f7a-4058-aed6-37d12bf1fade tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:13.882576 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34d5e41b-2f7a-4058-aed6-37d12bf1fade tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:13.883285 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34d5e41b-2f7a-4058-aed6-37d12bf1fade tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:13.962711 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-34d5e41b-2f7a-4058-aed6-37d12bf1fade tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:13.973428 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-34d5e41b-2f7a-4058-aed6-37d12bf1fade tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1246 microversion: 2.1 time: 0.114214 May 13 13:26:13.980554 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 211/431] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:13 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1246 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:14.595814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-584307ea-f812-488d-a560-8d4314e2e08d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:14.596456 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-584307ea-f812-488d-a560-8d4314e2e08d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:14.603348 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-584307ea-f812-488d-a560-8d4314e2e08d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:14.603792 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-584307ea-f812-488d-a560-8d4314e2e08d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:14.604568 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-584307ea-f812-488d-a560-8d4314e2e08d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:14.604993 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-584307ea-f812-488d-a560-8d4314e2e08d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:14.748746 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-584307ea-f812-488d-a560-8d4314e2e08d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:14.758165 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-584307ea-f812-488d-a560-8d4314e2e08d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:14.759736 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-584307ea-f812-488d-a560-8d4314e2e08d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:14.760974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-584307ea-f812-488d-a560-8d4314e2e08d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1810 microversion: 2.20 time: 0.169169 May 13 13:26:14.762304 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 221/432] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:14 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:14.992078 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-71c16fb4-b895-4fe3-b41a-de2695e8b16a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:14.992687 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-71c16fb4-b895-4fe3-b41a-de2695e8b16a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:14.998852 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-71c16fb4-b895-4fe3-b41a-de2695e8b16a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:14.999290 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-71c16fb4-b895-4fe3-b41a-de2695e8b16a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:15.000064 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-71c16fb4-b895-4fe3-b41a-de2695e8b16a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:15.000496 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-71c16fb4-b895-4fe3-b41a-de2695e8b16a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:15.072373 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-71c16fb4-b895-4fe3-b41a-de2695e8b16a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:15.081953 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-71c16fb4-b895-4fe3-b41a-de2695e8b16a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1246 microversion: 2.1 time: 0.094169 May 13 13:26:15.083633 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 212/433] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:14 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1246 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:26:15.780269 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-47fa417b-4c84-4302-9255-492259c7fbf0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:15.780835 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-47fa417b-4c84-4302-9255-492259c7fbf0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:15.787286 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-47fa417b-4c84-4302-9255-492259c7fbf0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:15.787884 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-47fa417b-4c84-4302-9255-492259c7fbf0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:15.788678 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-47fa417b-4c84-4302-9255-492259c7fbf0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:15.789119 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-47fa417b-4c84-4302-9255-492259c7fbf0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:15.946664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-47fa417b-4c84-4302-9255-492259c7fbf0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:15.957796 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-47fa417b-4c84-4302-9255-492259c7fbf0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:15.959340 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-47fa417b-4c84-4302-9255-492259c7fbf0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:15.960543 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-47fa417b-4c84-4302-9255-492259c7fbf0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1810 microversion: 2.20 time: 0.184393 May 13 13:26:15.965770 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 222/434] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:15 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1810 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:16.100714 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1900c227-5314-4ef5-aa00-5096aa4de300 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:16.101321 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1900c227-5314-4ef5-aa00-5096aa4de300 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:16.111680 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1900c227-5314-4ef5-aa00-5096aa4de300 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:16.113161 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1900c227-5314-4ef5-aa00-5096aa4de300 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:16.114530 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1900c227-5314-4ef5-aa00-5096aa4de300 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:16.115424 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1900c227-5314-4ef5-aa00-5096aa4de300 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:16.197198 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1900c227-5314-4ef5-aa00-5096aa4de300 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:16.205548 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1900c227-5314-4ef5-aa00-5096aa4de300 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1246 microversion: 2.1 time: 0.108783 May 13 13:26:16.206122 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 213/435] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:16 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1246 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:16.978490 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-265aa513-3fac-47af-9572-d662651d9d4a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:16.979121 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-265aa513-3fac-47af-9572-d662651d9d4a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:16.986405 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-265aa513-3fac-47af-9572-d662651d9d4a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:16.986852 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-265aa513-3fac-47af-9572-d662651d9d4a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:16.987619 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-265aa513-3fac-47af-9572-d662651d9d4a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:16.988052 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-265aa513-3fac-47af-9572-d662651d9d4a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:17.115711 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-265aa513-3fac-47af-9572-d662651d9d4a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:17.125233 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-265aa513-3fac-47af-9572-d662651d9d4a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:17.126803 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-265aa513-3fac-47af-9572-d662651d9d4a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:17.127961 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-265aa513-3fac-47af-9572-d662651d9d4a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1810 microversion: 2.20 time: 0.153350 May 13 13:26:17.128520 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 223/436] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:16 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:17.222309 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ad89bddc-a33d-4f13-bcbf-cfaf4d35ee1c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:17.222935 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ad89bddc-a33d-4f13-bcbf-cfaf4d35ee1c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:17.229310 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ad89bddc-a33d-4f13-bcbf-cfaf4d35ee1c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:17.229696 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ad89bddc-a33d-4f13-bcbf-cfaf4d35ee1c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:17.230513 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ad89bddc-a33d-4f13-bcbf-cfaf4d35ee1c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:17.230954 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ad89bddc-a33d-4f13-bcbf-cfaf4d35ee1c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:17.290783 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ad89bddc-a33d-4f13-bcbf-cfaf4d35ee1c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:17.298321 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ad89bddc-a33d-4f13-bcbf-cfaf4d35ee1c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1246 microversion: 2.1 time: 0.079815 May 13 13:26:17.298888 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 214/437] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:17 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1246 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:18.146730 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a168d969-918f-45f6-852f-32833e241d3f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:18.147333 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a168d969-918f-45f6-852f-32833e241d3f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:18.154319 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a168d969-918f-45f6-852f-32833e241d3f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:18.154765 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a168d969-918f-45f6-852f-32833e241d3f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:18.155526 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a168d969-918f-45f6-852f-32833e241d3f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:18.155957 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a168d969-918f-45f6-852f-32833e241d3f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:18.289303 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a168d969-918f-45f6-852f-32833e241d3f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:18.298287 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a168d969-918f-45f6-852f-32833e241d3f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:18.299790 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a168d969-918f-45f6-852f-32833e241d3f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:18.300957 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a168d969-918f-45f6-852f-32833e241d3f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1810 microversion: 2.20 time: 0.158094 May 13 13:26:18.301551 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 224/438] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:18 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:18.314851 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2def1e95-2fd9-43e8-bb9b-376dc4045030 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:18.315500 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2def1e95-2fd9-43e8-bb9b-376dc4045030 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:18.321766 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2def1e95-2fd9-43e8-bb9b-376dc4045030 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:18.322228 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2def1e95-2fd9-43e8-bb9b-376dc4045030 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:18.322998 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2def1e95-2fd9-43e8-bb9b-376dc4045030 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:18.323429 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2def1e95-2fd9-43e8-bb9b-376dc4045030 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:18.383661 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2def1e95-2fd9-43e8-bb9b-376dc4045030 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:18.391994 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2def1e95-2fd9-43e8-bb9b-376dc4045030 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1246 microversion: 2.1 time: 0.080774 May 13 13:26:18.392404 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 215/439] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:18 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:19.319142 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-07f5f759-8977-40dd-adcf-3eca7bd6d460 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:19.319835 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-07f5f759-8977-40dd-adcf-3eca7bd6d460 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:19.326457 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-07f5f759-8977-40dd-adcf-3eca7bd6d460 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:19.326900 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-07f5f759-8977-40dd-adcf-3eca7bd6d460 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:19.327663 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-07f5f759-8977-40dd-adcf-3eca7bd6d460 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:19.328093 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-07f5f759-8977-40dd-adcf-3eca7bd6d460 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:19.411421 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a2da7c26-645e-4f23-86da-0ca1cd8ec723 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:19.412180 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a2da7c26-645e-4f23-86da-0ca1cd8ec723 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:19.419732 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a2da7c26-645e-4f23-86da-0ca1cd8ec723 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:19.420173 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a2da7c26-645e-4f23-86da-0ca1cd8ec723 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:19.421230 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a2da7c26-645e-4f23-86da-0ca1cd8ec723 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:19.421669 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a2da7c26-645e-4f23-86da-0ca1cd8ec723 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:19.478428 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-07f5f759-8977-40dd-adcf-3eca7bd6d460 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:19.488295 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-07f5f759-8977-40dd-adcf-3eca7bd6d460 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:19.489810 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-07f5f759-8977-40dd-adcf-3eca7bd6d460 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:19.491014 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-07f5f759-8977-40dd-adcf-3eca7bd6d460 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1810 microversion: 2.20 time: 0.175851 May 13 13:26:19.491582 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 225/440] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:19 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:19.495359 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a2da7c26-645e-4f23-86da-0ca1cd8ec723 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:19.505974 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a2da7c26-645e-4f23-86da-0ca1cd8ec723 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1238 microversion: 2.1 time: 0.100056 May 13 13:26:19.506577 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 216/441] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:19 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1238 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:20.515140 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-34bda3cd-8518-4c47-968c-69fbe2ef1f83 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:20.521194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-34bda3cd-8518-4c47-968c-69fbe2ef1f83 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:20.523420 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-34bda3cd-8518-4c47-968c-69fbe2ef1f83 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:20.523879 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-34bda3cd-8518-4c47-968c-69fbe2ef1f83 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:20.524664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-34bda3cd-8518-4c47-968c-69fbe2ef1f83 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:20.525107 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-34bda3cd-8518-4c47-968c-69fbe2ef1f83 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:20.527129 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-418feacb-7633-4f73-abbc-f8f95d0e87f9 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:20.528404 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-418feacb-7633-4f73-abbc-f8f95d0e87f9 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:20.536244 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-418feacb-7633-4f73-abbc-f8f95d0e87f9 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:20.536788 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-418feacb-7633-4f73-abbc-f8f95d0e87f9 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:20.537740 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-418feacb-7633-4f73-abbc-f8f95d0e87f9 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:20.538275 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-418feacb-7633-4f73-abbc-f8f95d0e87f9 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:20.619783 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-418feacb-7633-4f73-abbc-f8f95d0e87f9 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:20.627591 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-418feacb-7633-4f73-abbc-f8f95d0e87f9 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1302 microversion: 2.1 time: 0.107515 May 13 13:26:20.628508 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 217/442] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:20 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1302 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:20.696323 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-34bda3cd-8518-4c47-968c-69fbe2ef1f83 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:20.705060 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-34bda3cd-8518-4c47-968c-69fbe2ef1f83 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:20.706719 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-34bda3cd-8518-4c47-968c-69fbe2ef1f83 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:20.707902 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-34bda3cd-8518-4c47-968c-69fbe2ef1f83 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1810 microversion: 2.20 time: 0.196786 May 13 13:26:20.708555 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 226/443] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:20 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1810 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:21.650664 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c2cc9982-70e4-4d46-98c8-7ffaac3b4b9b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:21.651314 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c2cc9982-70e4-4d46-98c8-7ffaac3b4b9b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:21.659830 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c2cc9982-70e4-4d46-98c8-7ffaac3b4b9b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:21.660373 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c2cc9982-70e4-4d46-98c8-7ffaac3b4b9b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:21.661255 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c2cc9982-70e4-4d46-98c8-7ffaac3b4b9b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:21.661964 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c2cc9982-70e4-4d46-98c8-7ffaac3b4b9b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:21.728825 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ae1dc4f7-b979-45a3-ada8-f11df5c9cfbb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:21.729348 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ae1dc4f7-b979-45a3-ada8-f11df5c9cfbb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:21.736603 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ae1dc4f7-b979-45a3-ada8-f11df5c9cfbb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:21.737049 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ae1dc4f7-b979-45a3-ada8-f11df5c9cfbb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:21.737588 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c2cc9982-70e4-4d46-98c8-7ffaac3b4b9b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:21.737838 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ae1dc4f7-b979-45a3-ada8-f11df5c9cfbb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:21.738283 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ae1dc4f7-b979-45a3-ada8-f11df5c9cfbb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:21.745913 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c2cc9982-70e4-4d46-98c8-7ffaac3b4b9b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1300 microversion: 2.1 time: 0.099159 May 13 13:26:21.747233 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 218/444] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:21 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1300 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:21.882238 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ae1dc4f7-b979-45a3-ada8-f11df5c9cfbb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:21.891648 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ae1dc4f7-b979-45a3-ada8-f11df5c9cfbb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:21.893277 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ae1dc4f7-b979-45a3-ada8-f11df5c9cfbb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:21.894540 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ae1dc4f7-b979-45a3-ada8-f11df5c9cfbb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1810 microversion: 2.20 time: 0.169764 May 13 13:26:21.895129 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 227/445] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:21 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:26:22.764633 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d5094d44-dffc-4c93-a6c8-199ef905a2a9 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:22.765208 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d5094d44-dffc-4c93-a6c8-199ef905a2a9 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:22.772361 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d5094d44-dffc-4c93-a6c8-199ef905a2a9 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:22.772805 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d5094d44-dffc-4c93-a6c8-199ef905a2a9 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:22.773571 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d5094d44-dffc-4c93-a6c8-199ef905a2a9 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:22.774026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d5094d44-dffc-4c93-a6c8-199ef905a2a9 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:22.914149 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0807d334-9745-432c-92c6-db54b104386a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:22.914900 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0807d334-9745-432c-92c6-db54b104386a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:22.921787 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0807d334-9745-432c-92c6-db54b104386a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:22.922251 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0807d334-9745-432c-92c6-db54b104386a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:22.923031 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0807d334-9745-432c-92c6-db54b104386a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:22.923651 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0807d334-9745-432c-92c6-db54b104386a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:22.923825 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d5094d44-dffc-4c93-a6c8-199ef905a2a9 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:22.931573 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d5094d44-dffc-4c93-a6c8-199ef905a2a9 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1368 microversion: 2.1 time: 0.171182 May 13 13:26:22.931988 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 219/446] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:22 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:23.289010 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0807d334-9745-432c-92c6-db54b104386a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:23.295891 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0807d334-9745-432c-92c6-db54b104386a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:23.297403 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0807d334-9745-432c-92c6-db54b104386a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:23.298601 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0807d334-9745-432c-92c6-db54b104386a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1810 microversion: 2.20 time: 0.388664 May 13 13:26:23.299165 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 228/447] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:22 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1810 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:23.400341 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-628a11ac-06a5-4d00-af23-98298d7a8f21 req-ad4ed91d-2a71-47b9-af81-c554087f667f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14bddf7f-e172-4c36-8cb5-8752d556e11b", "tag": "3545091d-ebe5-4fc8-8e1a-ed10472f81d7"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:26:23.414916 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-628a11ac-06a5-4d00-af23-98298d7a8f21 req-ad4ed91d-2a71-47b9-af81-c554087f667f service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:23.415511 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-628a11ac-06a5-4d00-af23-98298d7a8f21 req-ad4ed91d-2a71-47b9-af81-c554087f667f service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:23.429159 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-628a11ac-06a5-4d00-af23-98298d7a8f21 req-ad4ed91d-2a71-47b9-af81-c554087f667f service nova] Creating event network-changed:3545091d-ebe5-4fc8-8e1a-ed10472f81d7 for instance 14bddf7f-e172-4c36-8cb5-8752d556e11b on hv-cinder-84163 May 13 13:26:23.434653 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-628a11ac-06a5-4d00-af23-98298d7a8f21 req-ad4ed91d-2a71-47b9-af81-c554087f667f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038644 May 13 13:26:23.435265 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 220/448] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:26:23.948823 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8bfc3bf2-fbac-4e5c-8fcf-be8903c3d57a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:23.950929 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8bfc3bf2-fbac-4e5c-8fcf-be8903c3d57a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:23.957457 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8bfc3bf2-fbac-4e5c-8fcf-be8903c3d57a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:23.964206 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8bfc3bf2-fbac-4e5c-8fcf-be8903c3d57a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:23.964206 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8bfc3bf2-fbac-4e5c-8fcf-be8903c3d57a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:23.964206 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8bfc3bf2-fbac-4e5c-8fcf-be8903c3d57a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:24.090530 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8bfc3bf2-fbac-4e5c-8fcf-be8903c3d57a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:24.098415 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8bfc3bf2-fbac-4e5c-8fcf-be8903c3d57a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1368 microversion: 2.1 time: 0.153364 May 13 13:26:24.098995 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 229/449] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:23 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:24.318921 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d973811d-2034-4d01-94ff-18030a6056bf tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:24.319644 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d973811d-2034-4d01-94ff-18030a6056bf tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:24.327811 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d973811d-2034-4d01-94ff-18030a6056bf tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:24.328254 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d973811d-2034-4d01-94ff-18030a6056bf tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:24.329027 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d973811d-2034-4d01-94ff-18030a6056bf tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:24.329460 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d973811d-2034-4d01-94ff-18030a6056bf tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:24.472784 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d973811d-2034-4d01-94ff-18030a6056bf tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:24.482621 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d973811d-2034-4d01-94ff-18030a6056bf tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:24.484157 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d973811d-2034-4d01-94ff-18030a6056bf tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:24.485328 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d973811d-2034-4d01-94ff-18030a6056bf tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1810 microversion: 2.20 time: 0.171184 May 13 13:26:24.485978 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 221/450] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:24 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:25.115309 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-9d2cfe82-29dd-4df8-a03c-4b2cc3874f5d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:25.115960 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-9d2cfe82-29dd-4df8-a03c-4b2cc3874f5d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:25.123122 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9d2cfe82-29dd-4df8-a03c-4b2cc3874f5d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:25.123571 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9d2cfe82-29dd-4df8-a03c-4b2cc3874f5d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:25.124355 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9d2cfe82-29dd-4df8-a03c-4b2cc3874f5d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:25.124789 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9d2cfe82-29dd-4df8-a03c-4b2cc3874f5d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:25.269557 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-9d2cfe82-29dd-4df8-a03c-4b2cc3874f5d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:25.277929 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-9d2cfe82-29dd-4df8-a03c-4b2cc3874f5d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1368 microversion: 2.1 time: 0.166713 May 13 13:26:25.278548 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 230/451] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:25 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:25.504699 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b1130c55-b659-4f8d-839f-c5e85fec65dc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:25.505277 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b1130c55-b659-4f8d-839f-c5e85fec65dc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:25.512672 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b1130c55-b659-4f8d-839f-c5e85fec65dc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:25.513115 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b1130c55-b659-4f8d-839f-c5e85fec65dc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:25.513890 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b1130c55-b659-4f8d-839f-c5e85fec65dc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:25.514351 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b1130c55-b659-4f8d-839f-c5e85fec65dc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:25.655615 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b1130c55-b659-4f8d-839f-c5e85fec65dc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:25.671941 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b1130c55-b659-4f8d-839f-c5e85fec65dc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:25.674554 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b1130c55-b659-4f8d-839f-c5e85fec65dc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:25.676627 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b1130c55-b659-4f8d-839f-c5e85fec65dc tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1810 microversion: 2.20 time: 0.175650 May 13 13:26:25.677602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 222/452] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:25 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:26.295235 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d3711007-54ab-4aa2-8ed6-084ffd4b5a3c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:26.295769 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d3711007-54ab-4aa2-8ed6-084ffd4b5a3c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:26.302032 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d3711007-54ab-4aa2-8ed6-084ffd4b5a3c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:26.302513 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d3711007-54ab-4aa2-8ed6-084ffd4b5a3c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:26.303273 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d3711007-54ab-4aa2-8ed6-084ffd4b5a3c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:26.303699 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d3711007-54ab-4aa2-8ed6-084ffd4b5a3c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:26.437075 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d3711007-54ab-4aa2-8ed6-084ffd4b5a3c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:26.444668 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d3711007-54ab-4aa2-8ed6-084ffd4b5a3c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1368 microversion: 2.1 time: 0.153960 May 13 13:26:26.445240 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 231/453] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:26 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:26.697386 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b326bea4-93d9-4949-bdcf-dc880fff9eee tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:26.697984 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b326bea4-93d9-4949-bdcf-dc880fff9eee tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:26.704579 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b326bea4-93d9-4949-bdcf-dc880fff9eee tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:26.705020 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b326bea4-93d9-4949-bdcf-dc880fff9eee tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:26.708048 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b326bea4-93d9-4949-bdcf-dc880fff9eee tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:26.708048 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b326bea4-93d9-4949-bdcf-dc880fff9eee tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:26.842086 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b326bea4-93d9-4949-bdcf-dc880fff9eee tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:26.850491 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b326bea4-93d9-4949-bdcf-dc880fff9eee tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:26.851975 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b326bea4-93d9-4949-bdcf-dc880fff9eee tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:26.853165 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b326bea4-93d9-4949-bdcf-dc880fff9eee tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1810 microversion: 2.20 time: 0.159868 May 13 13:26:26.853720 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 223/454] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:26 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:27.461499 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3cc1ccea-901a-4fc2-96c2-d61672f3e7f7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:27.462833 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3cc1ccea-901a-4fc2-96c2-d61672f3e7f7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:27.470710 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3cc1ccea-901a-4fc2-96c2-d61672f3e7f7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:27.471152 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3cc1ccea-901a-4fc2-96c2-d61672f3e7f7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:27.471925 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3cc1ccea-901a-4fc2-96c2-d61672f3e7f7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:27.472352 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3cc1ccea-901a-4fc2-96c2-d61672f3e7f7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:27.609919 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3cc1ccea-901a-4fc2-96c2-d61672f3e7f7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:27.617125 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3cc1ccea-901a-4fc2-96c2-d61672f3e7f7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1368 microversion: 2.1 time: 0.159943 May 13 13:26:27.617689 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 232/455] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:27 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:26:27.872397 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-fd440542-b818-4d3c-89c6-3179df832be1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:27.873006 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-fd440542-b818-4d3c-89c6-3179df832be1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:27.879437 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd440542-b818-4d3c-89c6-3179df832be1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:27.879875 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd440542-b818-4d3c-89c6-3179df832be1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:27.880635 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd440542-b818-4d3c-89c6-3179df832be1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:27.881066 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd440542-b818-4d3c-89c6-3179df832be1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:28.008386 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fd440542-b818-4d3c-89c6-3179df832be1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:28.016944 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fd440542-b818-4d3c-89c6-3179df832be1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:28.018455 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fd440542-b818-4d3c-89c6-3179df832be1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:28.019578 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-fd440542-b818-4d3c-89c6-3179df832be1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1810 microversion: 2.20 time: 0.151617 May 13 13:26:28.020129 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 224/456] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:27 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:28.635043 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f065e741-84ae-4c11-aa4a-ea8a011a16dd tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:28.635680 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f065e741-84ae-4c11-aa4a-ea8a011a16dd tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:28.642703 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f065e741-84ae-4c11-aa4a-ea8a011a16dd tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:28.643138 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f065e741-84ae-4c11-aa4a-ea8a011a16dd tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:28.643897 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f065e741-84ae-4c11-aa4a-ea8a011a16dd tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:28.644377 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f065e741-84ae-4c11-aa4a-ea8a011a16dd tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:28.776607 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f065e741-84ae-4c11-aa4a-ea8a011a16dd tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:28.783460 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f065e741-84ae-4c11-aa4a-ea8a011a16dd tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1368 microversion: 2.1 time: 0.152245 May 13 13:26:28.784032 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 233/457] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:28 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:29.037557 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e49a6091-6775-445d-ad8f-6fae95825bb7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:29.038129 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e49a6091-6775-445d-ad8f-6fae95825bb7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:29.044621 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e49a6091-6775-445d-ad8f-6fae95825bb7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:29.045074 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e49a6091-6775-445d-ad8f-6fae95825bb7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:29.045857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e49a6091-6775-445d-ad8f-6fae95825bb7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:29.046332 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e49a6091-6775-445d-ad8f-6fae95825bb7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:29.176223 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e49a6091-6775-445d-ad8f-6fae95825bb7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:29.186657 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e49a6091-6775-445d-ad8f-6fae95825bb7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:29.188198 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e49a6091-6775-445d-ad8f-6fae95825bb7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:29.189381 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e49a6091-6775-445d-ad8f-6fae95825bb7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1810 microversion: 2.20 time: 0.155869 May 13 13:26:29.189944 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 225/458] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:29 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:29.800131 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-bae05d4d-e103-4120-a3ca-85e86f7de90d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:29.801466 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-bae05d4d-e103-4120-a3ca-85e86f7de90d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:29.807284 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bae05d4d-e103-4120-a3ca-85e86f7de90d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:29.809241 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bae05d4d-e103-4120-a3ca-85e86f7de90d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:29.809241 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bae05d4d-e103-4120-a3ca-85e86f7de90d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:29.809632 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bae05d4d-e103-4120-a3ca-85e86f7de90d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:29.940416 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-bae05d4d-e103-4120-a3ca-85e86f7de90d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:29.947757 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-bae05d4d-e103-4120-a3ca-85e86f7de90d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1368 microversion: 2.1 time: 0.151588 May 13 13:26:29.948326 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 234/459] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:29 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:30.208415 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8dc23c71-5d43-4908-9a2c-584a5a0d9efe tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:30.209128 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8dc23c71-5d43-4908-9a2c-584a5a0d9efe tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:30.216578 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8dc23c71-5d43-4908-9a2c-584a5a0d9efe tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:30.217018 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8dc23c71-5d43-4908-9a2c-584a5a0d9efe tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:30.217777 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8dc23c71-5d43-4908-9a2c-584a5a0d9efe tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:30.218220 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8dc23c71-5d43-4908-9a2c-584a5a0d9efe tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:30.354788 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8dc23c71-5d43-4908-9a2c-584a5a0d9efe tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:30.364326 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8dc23c71-5d43-4908-9a2c-584a5a0d9efe tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:30.365832 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8dc23c71-5d43-4908-9a2c-584a5a0d9efe tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:30.367021 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8dc23c71-5d43-4908-9a2c-584a5a0d9efe tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1810 microversion: 2.20 time: 0.162524 May 13 13:26:30.367750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 226/460] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:30 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:30.965176 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d6bd23b4-25b1-448b-b166-da182bf2981d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:30.965796 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d6bd23b4-25b1-448b-b166-da182bf2981d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:30.972331 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d6bd23b4-25b1-448b-b166-da182bf2981d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:30.972774 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d6bd23b4-25b1-448b-b166-da182bf2981d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:30.973523 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d6bd23b4-25b1-448b-b166-da182bf2981d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:30.973949 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d6bd23b4-25b1-448b-b166-da182bf2981d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:31.101754 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d6bd23b4-25b1-448b-b166-da182bf2981d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:31.110061 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d6bd23b4-25b1-448b-b166-da182bf2981d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1368 microversion: 2.1 time: 0.149466 May 13 13:26:31.110670 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 235/461] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:30 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:26:31.387479 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1582b60d-1ad6-4341-b783-36a437b86343 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:31.388074 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1582b60d-1ad6-4341-b783-36a437b86343 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:31.394682 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1582b60d-1ad6-4341-b783-36a437b86343 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:31.395173 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1582b60d-1ad6-4341-b783-36a437b86343 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:31.396030 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1582b60d-1ad6-4341-b783-36a437b86343 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:31.396491 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1582b60d-1ad6-4341-b783-36a437b86343 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:31.538476 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1582b60d-1ad6-4341-b783-36a437b86343 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:31.547303 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1582b60d-1ad6-4341-b783-36a437b86343 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:31.548823 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1582b60d-1ad6-4341-b783-36a437b86343 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:31.550000 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1582b60d-1ad6-4341-b783-36a437b86343 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1810 microversion: 2.20 time: 0.167234 May 13 13:26:31.550588 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 227/462] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:31 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:32.127346 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b08a77ad-e806-44ec-97d9-564d6cf06102 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:32.127958 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b08a77ad-e806-44ec-97d9-564d6cf06102 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:32.135835 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b08a77ad-e806-44ec-97d9-564d6cf06102 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:32.136305 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b08a77ad-e806-44ec-97d9-564d6cf06102 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:32.138169 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b08a77ad-e806-44ec-97d9-564d6cf06102 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:32.138990 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b08a77ad-e806-44ec-97d9-564d6cf06102 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:32.273419 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b08a77ad-e806-44ec-97d9-564d6cf06102 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:32.282464 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b08a77ad-e806-44ec-97d9-564d6cf06102 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1368 microversion: 2.1 time: 0.158826 May 13 13:26:32.283223 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 236/463] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:32 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:32.357141 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-2cbc85bb-7d82-461a-9465-e0240de24cc8 req-fb494f69-e979-4420-b586-c1d3fca84f90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6", "name": "network-vif-plugged", "status": "completed", "tag": "c523458e-8e82-46df-bfae-db11fc8b2ec5"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:26:32.367575 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-2cbc85bb-7d82-461a-9465-e0240de24cc8 req-fb494f69-e979-4420-b586-c1d3fca84f90 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:32.368014 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-2cbc85bb-7d82-461a-9465-e0240de24cc8 req-fb494f69-e979-4420-b586-c1d3fca84f90 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:32.379801 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-2cbc85bb-7d82-461a-9465-e0240de24cc8 req-fb494f69-e979-4420-b586-c1d3fca84f90 service nova] Creating event network-vif-plugged:c523458e-8e82-46df-bfae-db11fc8b2ec5 for instance 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 on hv-cinder-84163 May 13 13:26:32.384985 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-2cbc85bb-7d82-461a-9465-e0240de24cc8 req-fb494f69-e979-4420-b586-c1d3fca84f90 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034889 May 13 13:26:32.388938 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 228/464] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:26:32.568888 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-dca62247-28ba-4965-9b4d-e0e7ec39c4ab tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:32.569645 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-dca62247-28ba-4965-9b4d-e0e7ec39c4ab tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:32.576369 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dca62247-28ba-4965-9b4d-e0e7ec39c4ab tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:32.576888 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dca62247-28ba-4965-9b4d-e0e7ec39c4ab tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:32.577680 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dca62247-28ba-4965-9b4d-e0e7ec39c4ab tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:32.578112 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dca62247-28ba-4965-9b4d-e0e7ec39c4ab tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:32.712727 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-dca62247-28ba-4965-9b4d-e0e7ec39c4ab tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:32.721401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-dca62247-28ba-4965-9b4d-e0e7ec39c4ab tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:32.723044 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-dca62247-28ba-4965-9b4d-e0e7ec39c4ab tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:32.724180 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-dca62247-28ba-4965-9b4d-e0e7ec39c4ab tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1810 microversion: 2.20 time: 0.159515 May 13 13:26:32.724735 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 237/465] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:32 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:33.301060 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9dc6a712-c79e-4ff3-a210-312ef652913b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:33.301754 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9dc6a712-c79e-4ff3-a210-312ef652913b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:33.307965 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9dc6a712-c79e-4ff3-a210-312ef652913b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:33.309054 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9dc6a712-c79e-4ff3-a210-312ef652913b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:33.310364 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9dc6a712-c79e-4ff3-a210-312ef652913b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:33.310830 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9dc6a712-c79e-4ff3-a210-312ef652913b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:33.446312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9dc6a712-c79e-4ff3-a210-312ef652913b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:33.454914 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9dc6a712-c79e-4ff3-a210-312ef652913b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1368 microversion: 2.1 time: 0.158754 May 13 13:26:33.455486 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 229/466] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:33 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:33.743570 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cd7b67ad-5f99-4ed2-8c2b-5f9bf08a8a81 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:33.744174 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-cd7b67ad-5f99-4ed2-8c2b-5f9bf08a8a81 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:33.751972 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cd7b67ad-5f99-4ed2-8c2b-5f9bf08a8a81 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:33.752416 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cd7b67ad-5f99-4ed2-8c2b-5f9bf08a8a81 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:33.753262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cd7b67ad-5f99-4ed2-8c2b-5f9bf08a8a81 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:33.753694 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cd7b67ad-5f99-4ed2-8c2b-5f9bf08a8a81 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:33.895958 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-cd7b67ad-5f99-4ed2-8c2b-5f9bf08a8a81 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:33.904735 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-cd7b67ad-5f99-4ed2-8c2b-5f9bf08a8a81 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:33.906257 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-cd7b67ad-5f99-4ed2-8c2b-5f9bf08a8a81 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:33.907403 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-cd7b67ad-5f99-4ed2-8c2b-5f9bf08a8a81 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1810 microversion: 2.20 time: 0.167960 May 13 13:26:33.907961 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 238/467] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:33 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:34.472096 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4d7fbe34-96b8-4c86-a2cf-81c0f368f880 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:34.472655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4d7fbe34-96b8-4c86-a2cf-81c0f368f880 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:34.478973 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4d7fbe34-96b8-4c86-a2cf-81c0f368f880 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:34.479438 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4d7fbe34-96b8-4c86-a2cf-81c0f368f880 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:34.480348 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4d7fbe34-96b8-4c86-a2cf-81c0f368f880 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:34.480783 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4d7fbe34-96b8-4c86-a2cf-81c0f368f880 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:34.619943 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4d7fbe34-96b8-4c86-a2cf-81c0f368f880 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:34.628068 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4d7fbe34-96b8-4c86-a2cf-81c0f368f880 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1368 microversion: 2.1 time: 0.159913 May 13 13:26:34.628627 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 230/468] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:34 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:26:34.685535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7646bbe0-006d-43f7-9ce6-1481e01ec3bb tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:34.686028 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7646bbe0-006d-43f7-9ce6-1481e01ec3bb tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 7d22c736-3272-4f3c-950b-12fc33d878ba] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:34.692036 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7646bbe0-006d-43f7-9ce6-1481e01ec3bb tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:34.692481 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7646bbe0-006d-43f7-9ce6-1481e01ec3bb tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:34.693248 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7646bbe0-006d-43f7-9ce6-1481e01ec3bb tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:34.693678 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7646bbe0-006d-43f7-9ce6-1481e01ec3bb tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:34.774362 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-7646bbe0-006d-43f7-9ce6-1481e01ec3bb tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lazy-loading 'services' on Instance uuid 7d22c736-3272-4f3c-950b-12fc33d878ba {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:26:34.927163 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a032628e-3ea7-4012-ae42-86c5719244bb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:34.928065 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a032628e-3ea7-4012-ae42-86c5719244bb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:34.935628 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a032628e-3ea7-4012-ae42-86c5719244bb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:34.940404 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a032628e-3ea7-4012-ae42-86c5719244bb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:34.940404 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a032628e-3ea7-4012-ae42-86c5719244bb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:34.940404 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a032628e-3ea7-4012-ae42-86c5719244bb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:35.010868 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7646bbe0-006d-43f7-9ce6-1481e01ec3bb tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba/os-volume_attachments/0cfe3157-3bc2-414e-b517-72c1b151e7d4" status: 202 len: 0 microversion: 2.1 time: 0.329656 May 13 13:26:35.014827 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 239/469] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 13 13:26:34 2022] DELETE /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba/os-volume_attachments/0cfe3157-3bc2-414e-b517-72c1b151e7d4 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:26:35.088782 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a032628e-3ea7-4012-ae42-86c5719244bb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:35.101175 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a032628e-3ea7-4012-ae42-86c5719244bb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:35.103030 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a032628e-3ea7-4012-ae42-86c5719244bb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:35.104216 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a032628e-3ea7-4012-ae42-86c5719244bb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1810 microversion: 2.20 time: 0.181231 May 13 13:26:35.104857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 231/470] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:34 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:35.645773 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f0415de5-4f32-4fbd-9f2a-9c4a6c08fdbe tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:35.646616 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f0415de5-4f32-4fbd-9f2a-9c4a6c08fdbe tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:35.659818 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f0415de5-4f32-4fbd-9f2a-9c4a6c08fdbe tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:35.659818 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f0415de5-4f32-4fbd-9f2a-9c4a6c08fdbe tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:35.659818 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f0415de5-4f32-4fbd-9f2a-9c4a6c08fdbe tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:35.659818 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f0415de5-4f32-4fbd-9f2a-9c4a6c08fdbe tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:35.799104 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f0415de5-4f32-4fbd-9f2a-9c4a6c08fdbe tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:35.806764 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f0415de5-4f32-4fbd-9f2a-9c4a6c08fdbe tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1368 microversion: 2.1 time: 0.165489 May 13 13:26:35.807337 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 240/471] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:35 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:36.123981 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9bafa300-3345-40b1-b17c-580c07ae064f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:36.126050 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9bafa300-3345-40b1-b17c-580c07ae064f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:36.131191 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9bafa300-3345-40b1-b17c-580c07ae064f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:36.131648 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9bafa300-3345-40b1-b17c-580c07ae064f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:36.132605 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9bafa300-3345-40b1-b17c-580c07ae064f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:36.133047 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9bafa300-3345-40b1-b17c-580c07ae064f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:36.281178 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9bafa300-3345-40b1-b17c-580c07ae064f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:36.291003 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9bafa300-3345-40b1-b17c-580c07ae064f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:36.292530 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9bafa300-3345-40b1-b17c-580c07ae064f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:36.294117 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9bafa300-3345-40b1-b17c-580c07ae064f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1810 microversion: 2.20 time: 0.175151 May 13 13:26:36.298283 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 232/472] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:36 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:36.532071 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-da9d7f7b-e48c-4287-a712-291ad543b519 req-fa3cabe1-108e-4481-9b46-c82fc280c6fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14bddf7f-e172-4c36-8cb5-8752d556e11b", "name": "network-vif-plugged", "status": "completed", "tag": "3545091d-ebe5-4fc8-8e1a-ed10472f81d7"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:26:36.540218 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-da9d7f7b-e48c-4287-a712-291ad543b519 req-fa3cabe1-108e-4481-9b46-c82fc280c6fa service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:36.540657 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-da9d7f7b-e48c-4287-a712-291ad543b519 req-fa3cabe1-108e-4481-9b46-c82fc280c6fa service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:36.552510 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-da9d7f7b-e48c-4287-a712-291ad543b519 req-fa3cabe1-108e-4481-9b46-c82fc280c6fa service nova] Creating event network-vif-plugged:3545091d-ebe5-4fc8-8e1a-ed10472f81d7 for instance 14bddf7f-e172-4c36-8cb5-8752d556e11b on hv-cinder-84163 May 13 13:26:36.557238 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-da9d7f7b-e48c-4287-a712-291ad543b519 req-fa3cabe1-108e-4481-9b46-c82fc280c6fa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028763 May 13 13:26:36.557814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 241/473] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:26:36.823560 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9b33cf12-e078-4f49-a238-cff061faa79e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:36.824242 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9b33cf12-e078-4f49-a238-cff061faa79e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:36.830297 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9b33cf12-e078-4f49-a238-cff061faa79e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:36.830746 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9b33cf12-e078-4f49-a238-cff061faa79e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:36.831537 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9b33cf12-e078-4f49-a238-cff061faa79e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:36.831967 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9b33cf12-e078-4f49-a238-cff061faa79e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:36.968165 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9b33cf12-e078-4f49-a238-cff061faa79e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:36.975433 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9b33cf12-e078-4f49-a238-cff061faa79e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1368 microversion: 2.1 time: 0.155783 May 13 13:26:36.975994 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 233/474] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:36 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:26:37.217818 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3698e5bb-1179-4743-ae13-ea69f3b4b4e0 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:37.218440 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3698e5bb-1179-4743-ae13-ea69f3b4b4e0 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 7d22c736-3272-4f3c-950b-12fc33d878ba] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:37.225077 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3698e5bb-1179-4743-ae13-ea69f3b4b4e0 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:37.225520 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3698e5bb-1179-4743-ae13-ea69f3b4b4e0 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:37.226327 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3698e5bb-1179-4743-ae13-ea69f3b4b4e0 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:37.226758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3698e5bb-1179-4743-ae13-ea69f3b4b4e0 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:37.253194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3698e5bb-1179-4743-ae13-ea69f3b4b4e0 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 7d22c736-3272-4f3c-950b-12fc33d878ba] Going to try to terminate instance {{(pid=117721) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:26:37.312764 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f96a97db-f462-4671-b706-98242c6a6b16 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:37.313367 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f96a97db-f462-4671-b706-98242c6a6b16 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:37.320350 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f96a97db-f462-4671-b706-98242c6a6b16 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:37.320799 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f96a97db-f462-4671-b706-98242c6a6b16 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:37.321577 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f96a97db-f462-4671-b706-98242c6a6b16 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:37.322004 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f96a97db-f462-4671-b706-98242c6a6b16 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:37.463446 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f96a97db-f462-4671-b706-98242c6a6b16 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:37.472663 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f96a97db-f462-4671-b706-98242c6a6b16 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:37.475194 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f96a97db-f462-4671-b706-98242c6a6b16 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:37.475313 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f96a97db-f462-4671-b706-98242c6a6b16 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1797 microversion: 2.20 time: 0.166889 May 13 13:26:37.475887 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 234/475] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:26:37 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1797 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:26:37.541652 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3698e5bb-1179-4743-ae13-ea69f3b4b4e0 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba" status: 204 len: 0 microversion: 2.1 time: 0.329694 May 13 13:26:37.542270 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 242/476] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:26:37 2022] DELETE /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:26:37.550805 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a938f555-18dc-4978-ac38-6ceeb159caa0 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:37.555478 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a938f555-18dc-4978-ac38-6ceeb159caa0 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 7d22c736-3272-4f3c-950b-12fc33d878ba] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:37.557359 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a938f555-18dc-4978-ac38-6ceeb159caa0 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:37.557802 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a938f555-18dc-4978-ac38-6ceeb159caa0 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:37.559237 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a938f555-18dc-4978-ac38-6ceeb159caa0 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:37.559822 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a938f555-18dc-4978-ac38-6ceeb159caa0 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:37.688194 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a938f555-18dc-4978-ac38-6ceeb159caa0 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:37.695667 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a938f555-18dc-4978-ac38-6ceeb159caa0 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba" status: 200 len: 1511 microversion: 2.1 time: 0.148654 May 13 13:26:37.696233 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 235/477] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:37 2022] GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:37.993423 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4b2a4d02-61af-4171-b09c-191495b3c2e4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:37.994112 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4b2a4d02-61af-4171-b09c-191495b3c2e4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:38.000947 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4b2a4d02-61af-4171-b09c-191495b3c2e4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:38.001382 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4b2a4d02-61af-4171-b09c-191495b3c2e4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:38.002172 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4b2a4d02-61af-4171-b09c-191495b3c2e4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:38.002620 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4b2a4d02-61af-4171-b09c-191495b3c2e4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:38.141666 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4b2a4d02-61af-4171-b09c-191495b3c2e4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:38.157798 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4b2a4d02-61af-4171-b09c-191495b3c2e4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1368 microversion: 2.1 time: 0.168470 May 13 13:26:38.158417 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 243/478] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:37 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:38.713316 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c6e4dce9-c922-48c1-a328-f964dc15c022 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:38.713874 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c6e4dce9-c922-48c1-a328-f964dc15c022 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 7d22c736-3272-4f3c-950b-12fc33d878ba] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:38.720958 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c6e4dce9-c922-48c1-a328-f964dc15c022 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:38.721421 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c6e4dce9-c922-48c1-a328-f964dc15c022 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:38.722163 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c6e4dce9-c922-48c1-a328-f964dc15c022 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:38.722617 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c6e4dce9-c922-48c1-a328-f964dc15c022 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:38.851980 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c6e4dce9-c922-48c1-a328-f964dc15c022 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:38.859660 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c6e4dce9-c922-48c1-a328-f964dc15c022 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba" status: 200 len: 1511 microversion: 2.1 time: 0.150583 May 13 13:26:38.860231 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 236/479] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:38 2022] GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:26:39.174305 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1ab0eac0-4400-4167-95ec-608bf3a3c8f0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:39.174881 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1ab0eac0-4400-4167-95ec-608bf3a3c8f0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:39.181170 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1ab0eac0-4400-4167-95ec-608bf3a3c8f0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:39.181611 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1ab0eac0-4400-4167-95ec-608bf3a3c8f0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:39.182404 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1ab0eac0-4400-4167-95ec-608bf3a3c8f0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:39.182835 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1ab0eac0-4400-4167-95ec-608bf3a3c8f0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:39.319594 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1ab0eac0-4400-4167-95ec-608bf3a3c8f0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:39.327765 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1ab0eac0-4400-4167-95ec-608bf3a3c8f0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1368 microversion: 2.1 time: 0.157324 May 13 13:26:39.328326 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 244/480] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:39 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:39.877021 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d659e48d-3b7c-4b82-8563-681da7d15bcb tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:39.877628 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d659e48d-3b7c-4b82-8563-681da7d15bcb tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 7d22c736-3272-4f3c-950b-12fc33d878ba] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:39.883969 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d659e48d-3b7c-4b82-8563-681da7d15bcb tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:39.884415 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d659e48d-3b7c-4b82-8563-681da7d15bcb tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:39.885175 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d659e48d-3b7c-4b82-8563-681da7d15bcb tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:39.885605 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d659e48d-3b7c-4b82-8563-681da7d15bcb tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:40.014983 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d659e48d-3b7c-4b82-8563-681da7d15bcb tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:40.024088 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d659e48d-3b7c-4b82-8563-681da7d15bcb tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba" status: 200 len: 1511 microversion: 2.1 time: 0.150916 May 13 13:26:40.024665 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 237/481] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:39 2022] GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:40.344580 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-73a40f51-ec13-48c0-bb18-361dab5d169a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:40.345189 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-73a40f51-ec13-48c0-bb18-361dab5d169a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:40.351941 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73a40f51-ec13-48c0-bb18-361dab5d169a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:40.352386 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73a40f51-ec13-48c0-bb18-361dab5d169a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:40.353190 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73a40f51-ec13-48c0-bb18-361dab5d169a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:40.353626 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73a40f51-ec13-48c0-bb18-361dab5d169a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:40.489915 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-73a40f51-ec13-48c0-bb18-361dab5d169a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:40.498030 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-73a40f51-ec13-48c0-bb18-361dab5d169a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1557 microversion: 2.1 time: 0.157367 May 13 13:26:40.498636 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 245/482] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:40 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:40.514698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f9c07f02-55c1-464b-8b8b-63a227474e6f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:40.515181 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f9c07f02-55c1-464b-8b8b-63a227474e6f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:40.521137 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f9c07f02-55c1-464b-8b8b-63a227474e6f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:40.521587 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f9c07f02-55c1-464b-8b8b-63a227474e6f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:40.522402 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f9c07f02-55c1-464b-8b8b-63a227474e6f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:40.522846 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f9c07f02-55c1-464b-8b8b-63a227474e6f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:40.607379 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f9c07f02-55c1-464b-8b8b-63a227474e6f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096634 May 13 13:26:40.608061 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 238/483] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 13 13:26:40 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:26:41.036737 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-578ac46f-4f9d-41a5-94d8-e7adfcd88249 req-f275a6c4-6437-4e3d-9fb8-67877a9ff679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d22c736-3272-4f3c-950b-12fc33d878ba", "name": "network-vif-deleted", "tag": "0299a732-f26e-4354-82c8-4c45974d6071"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:26:41.045441 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-be5ee781-a75c-46b8-96de-44308fb48968 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:41.046051 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-be5ee781-a75c-46b8-96de-44308fb48968 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 7d22c736-3272-4f3c-950b-12fc33d878ba] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:41.053409 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-578ac46f-4f9d-41a5-94d8-e7adfcd88249 req-f275a6c4-6437-4e3d-9fb8-67877a9ff679 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:41.053864 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-578ac46f-4f9d-41a5-94d8-e7adfcd88249 req-f275a6c4-6437-4e3d-9fb8-67877a9ff679 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:41.062492 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-be5ee781-a75c-46b8-96de-44308fb48968 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:41.062942 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-be5ee781-a75c-46b8-96de-44308fb48968 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:41.063715 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-be5ee781-a75c-46b8-96de-44308fb48968 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:41.064149 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-be5ee781-a75c-46b8-96de-44308fb48968 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:41.065795 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-578ac46f-4f9d-41a5-94d8-e7adfcd88249 req-f275a6c4-6437-4e3d-9fb8-67877a9ff679 service nova] Creating event network-vif-deleted:0299a732-f26e-4354-82c8-4c45974d6071 for instance 7d22c736-3272-4f3c-950b-12fc33d878ba on hv-cinder-84163 May 13 13:26:41.071553 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-578ac46f-4f9d-41a5-94d8-e7adfcd88249 req-f275a6c4-6437-4e3d-9fb8-67877a9ff679 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039537 May 13 13:26:41.075607 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 246/484] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:26:41.129529 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-be5ee781-a75c-46b8-96de-44308fb48968 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:41.140156 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-be5ee781-a75c-46b8-96de-44308fb48968 tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba" status: 200 len: 1469 microversion: 2.1 time: 0.100076 May 13 13:26:41.141585 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 239/485] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:41 2022] GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba => generated 1469 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:41.144256 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-979c8601-0c18-4211-a48f-1326e4b01f2c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:41.144789 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-979c8601-0c18-4211-a48f-1326e4b01f2c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:41.150902 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-979c8601-0c18-4211-a48f-1326e4b01f2c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:41.153259 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-979c8601-0c18-4211-a48f-1326e4b01f2c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:41.153259 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-979c8601-0c18-4211-a48f-1326e4b01f2c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:41.153259 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-979c8601-0c18-4211-a48f-1326e4b01f2c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:41.247527 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-979c8601-0c18-4211-a48f-1326e4b01f2c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lazy-loading 'services' on Instance uuid 3b2c2709-a695-4f16-a0fa-fed674cfab86 {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:26:41.495416 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-979c8601-0c18-4211-a48f-1326e4b01f2c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86/os-volume_attachments/fcd97759-8cae-4d0a-aef5-3ffc92b21a8e" status: 202 len: 0 microversion: 2.1 time: 0.355896 May 13 13:26:41.496990 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 247/486] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 13 13:26:41 2022] DELETE /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86/os-volume_attachments/fcd97759-8cae-4d0a-aef5-3ffc92b21a8e => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:26:42.157256 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7161845e-7f87-47dd-b315-7d3b73223cbd tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:42.158146 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7161845e-7f87-47dd-b315-7d3b73223cbd tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 7d22c736-3272-4f3c-950b-12fc33d878ba] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:42.164796 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7161845e-7f87-47dd-b315-7d3b73223cbd tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:42.165250 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7161845e-7f87-47dd-b315-7d3b73223cbd tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:42.166073 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7161845e-7f87-47dd-b315-7d3b73223cbd tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:42.166572 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7161845e-7f87-47dd-b315-7d3b73223cbd tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:42.214480 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7161845e-7f87-47dd-b315-7d3b73223cbd tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:42.215005 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7161845e-7f87-47dd-b315-7d3b73223cbd tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:42.215382 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-7161845e-7f87-47dd-b315-7d3b73223cbd tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lazy-loading 'fault' on Instance uuid 7d22c736-3272-4f3c-950b-12fc33d878ba {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:26:42.270306 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7161845e-7f87-47dd-b315-7d3b73223cbd tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b40229043f46fea15181b950a892fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06d65a7a7d244d8b8f97aab0ef63684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:42.279898 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7161845e-7f87-47dd-b315-7d3b73223cbd tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba" status: 200 len: 1309 microversion: 2.1 time: 0.126408 May 13 13:26:42.280489 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 240/487] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:42 2022] GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba => generated 1309 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:43.089502 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-24a9d000-500b-42fe-b44f-9dbcdf6da3df req-5120f987-6e1b-4643-a796-8d31e524e1a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14bddf7f-e172-4c36-8cb5-8752d556e11b", "tag": "3545091d-ebe5-4fc8-8e1a-ed10472f81d7"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:26:43.097899 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-24a9d000-500b-42fe-b44f-9dbcdf6da3df req-5120f987-6e1b-4643-a796-8d31e524e1a4 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:43.098449 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-24a9d000-500b-42fe-b44f-9dbcdf6da3df req-5120f987-6e1b-4643-a796-8d31e524e1a4 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:43.109265 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-24a9d000-500b-42fe-b44f-9dbcdf6da3df req-5120f987-6e1b-4643-a796-8d31e524e1a4 service nova] Creating event network-changed:3545091d-ebe5-4fc8-8e1a-ed10472f81d7 for instance 14bddf7f-e172-4c36-8cb5-8752d556e11b on hv-cinder-84163 May 13 13:26:43.114118 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-24a9d000-500b-42fe-b44f-9dbcdf6da3df req-5120f987-6e1b-4643-a796-8d31e524e1a4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029442 May 13 13:26:43.115088 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 248/488] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:26:43.301917 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3cae438f-bfc8-42cf-822d-22d858d6e46e tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:43.302564 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3cae438f-bfc8-42cf-822d-22d858d6e46e tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] [instance: 7d22c736-3272-4f3c-950b-12fc33d878ba] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:43.309565 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3cae438f-bfc8-42cf-822d-22d858d6e46e tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:43.310007 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3cae438f-bfc8-42cf-822d-22d858d6e46e tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:43.310803 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3cae438f-bfc8-42cf-822d-22d858d6e46e tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:43.311236 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3cae438f-bfc8-42cf-822d-22d858d6e46e tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:43.324778 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-3cae438f-bfc8-42cf-822d-22d858d6e46e tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] HTTP exception thrown: Instance 7d22c736-3272-4f3c-950b-12fc33d878ba could not be found. May 13 13:26:43.326463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3cae438f-bfc8-42cf-822d-22d858d6e46e tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Request method failure captured: May 13 13:26:43.326463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba HTTP/1.1 May 13 13:26:43.326463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept: application/json May 13 13:26:43.326463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity May 13 13:26:43.326463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Connection: close May 13 13:26:43.326463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Length: 0 May 13 13:26:43.326463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Type: application/json May 13 13:26:43.326463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Host: 10.222.0.13 May 13 13:26:43.326463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None May 13 13:26:43.326463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 May 13 13:26:43.326463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiflvz18XsfI48PomFulF794TtZnr9EVirDWd_5KXFGXMCmjtl1qa0e9ORkDg0zIBAWaWzKTLlH4U_BsOgWZe0kUcOacfUmsYciaW04LH3gYV7yCjUBtviOehVQerE9pJo0c6EX8uLX5fYe_Af-t6396OncB63iGEoEDb7GE-jmEU2cr4 May 13 13:26:43.326463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Id: None May 13 13:26:43.326463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Name: None May 13 13:26:43.326463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed May 13 13:26:43.326463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True May 13 13:26:43.326463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default May 13 13:26:43.326463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default May 13 13:26:43.326463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Id: a06d65a7a7d244d8b8f97aab0ef63684 May 13 13:26:43.326463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-VolumesSnapshotTestJSON-940237884 May 13 13:26:43.326463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Role: member,reader May 13 13:26:43.326463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Roles: member,reader May 13 13:26:43.327829 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a06d65a7a7d244d8b8f97aab0ef63684", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a06d65a7a7d244d8b8f97aab0ef63684"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a06d65a7a7d244d8b8f97aab0ef63684"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a06d65a7a7d244d8b8f97aab0ef63684"}]}] May 13 13:26:43.327829 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-VolumesSnapshotTestJSON-940237884 May 13 13:26:43.327829 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Id: a06d65a7a7d244d8b8f97aab0ef63684 May 13 13:26:43.327829 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-940237884 May 13 13:26:43.327829 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User: tempest-VolumesSnapshotTestJSON-940237884-project May 13 13:26:43.327829 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default May 13 13:26:43.327829 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default May 13 13:26:43.327829 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Id: 18b40229043f46fea15181b950a892fd May 13 13:26:43.327829 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-VolumesSnapshotTestJSON-940237884-project May 13 13:26:43.327829 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: method: > May 13 13:26:43.327829 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: exception: Instance 7d22c736-3272-4f3c-950b-12fc33d878ba could not be found. May 13 13:26:43.327829 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: action_args: {'id': '7d22c736-3272-4f3c-950b-12fc33d878ba'} May 13 13:26:43.328908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:26:43.328908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:26:43.328908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:26:43.328908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:26:43.328908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:26:43.328908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:26:43.328908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:26:43.328908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:26:43.328908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:26:43.328908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:26:43.328908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d22c736-3272-4f3c-950b-12fc33d878ba could not be found. May 13 13:26:43.328908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:26:43.328908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:26:43.328908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:26:43.328908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:26:43.328908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:26:43.328908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:26:43.328908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:26:43.328908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:26:43.328908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:26:43.330654 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:26:43.330654 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:26:43.330654 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:26:43.330654 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:26:43.330654 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:26:43.330654 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:26:43.330654 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:26:43.330654 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d22c736-3272-4f3c-950b-12fc33d878ba could not be found. May 13 13:26:43.330654 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:26:43.330654 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:26:43.330654 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:26:43.330654 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:26:43.330654 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:26:43.330654 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:26:43.330654 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:26:43.330654 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:26:43.330654 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d22c736-3272-4f3c-950b-12fc33d878ba could not be found. May 13 13:26:43.330654 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:26:43.331888 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3cae438f-bfc8-42cf-822d-22d858d6e46e tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] Returning 404 to user: Instance 7d22c736-3272-4f3c-950b-12fc33d878ba could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:26:43.331888 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3cae438f-bfc8-42cf-822d-22d858d6e46e tempest-VolumesSnapshotTestJSON-940237884 tempest-VolumesSnapshotTestJSON-940237884-project] 10.222.0.13 "GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba" status: 404 len: 111 microversion: 2.1 time: 0.029830 May 13 13:26:43.331888 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 241/489] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:43 2022] GET /compute/v2.1/servers/7d22c736-3272-4f3c-950b-12fc33d878ba => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:26:43.669771 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5a9ab518-cc0c-424b-9580-0ebc95ca6188 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:26:43.676747 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5a9ab518-cc0c-424b-9580-0ebc95ca6188 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:43.677310 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5a9ab518-cc0c-424b-9580-0ebc95ca6188 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:43.704487 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5a9ab518-cc0c-424b-9580-0ebc95ca6188 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Going to try to stop instance {{(pid=117721) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 13 13:26:43.955998 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5a9ab518-cc0c-424b-9580-0ebc95ca6188 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "POST /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86/action" status: 202 len: 0 microversion: 2.1 time: 0.291718 May 13 13:26:43.956767 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 249/490] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 13 13:26:43 2022] POST /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:26:43.966431 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-cbed6114-a750-4a4a-9f9f-706263cd2257 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:43.973448 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-cbed6114-a750-4a4a-9f9f-706263cd2257 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:43.973448 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cbed6114-a750-4a4a-9f9f-706263cd2257 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:43.973894 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cbed6114-a750-4a4a-9f9f-706263cd2257 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:43.974698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cbed6114-a750-4a4a-9f9f-706263cd2257 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:43.975541 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cbed6114-a750-4a4a-9f9f-706263cd2257 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:44.117737 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-cbed6114-a750-4a4a-9f9f-706263cd2257 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:44.126089 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-cbed6114-a750-4a4a-9f9f-706263cd2257 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1676 microversion: 2.1 time: 0.164881 May 13 13:26:44.126701 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 242/491] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:43 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:45.144690 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8d73d704-10d9-407e-8413-65e3fd01adee tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:45.145382 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8d73d704-10d9-407e-8413-65e3fd01adee tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:45.151394 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8d73d704-10d9-407e-8413-65e3fd01adee tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:45.151846 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8d73d704-10d9-407e-8413-65e3fd01adee tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:45.153163 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8d73d704-10d9-407e-8413-65e3fd01adee tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:45.153322 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8d73d704-10d9-407e-8413-65e3fd01adee tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:45.285226 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8d73d704-10d9-407e-8413-65e3fd01adee tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:45.292754 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8d73d704-10d9-407e-8413-65e3fd01adee tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1676 microversion: 2.1 time: 0.152656 May 13 13:26:45.293321 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 250/492] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:45 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:46.311266 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-41abc7a9-676b-4c60-9094-b5a3df403968 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:46.311865 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-41abc7a9-676b-4c60-9094-b5a3df403968 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:46.318162 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-41abc7a9-676b-4c60-9094-b5a3df403968 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:46.318637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-41abc7a9-676b-4c60-9094-b5a3df403968 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:46.319423 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-41abc7a9-676b-4c60-9094-b5a3df403968 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:46.319851 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-41abc7a9-676b-4c60-9094-b5a3df403968 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:46.448211 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-41abc7a9-676b-4c60-9094-b5a3df403968 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:46.455995 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-41abc7a9-676b-4c60-9094-b5a3df403968 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1676 microversion: 2.1 time: 0.149453 May 13 13:26:46.456483 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 243/493] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:46 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:47.473280 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e85f67bf-16b4-44a9-a33f-52f0e8d55e46 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:47.473827 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e85f67bf-16b4-44a9-a33f-52f0e8d55e46 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:47.480416 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e85f67bf-16b4-44a9-a33f-52f0e8d55e46 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:47.480863 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e85f67bf-16b4-44a9-a33f-52f0e8d55e46 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:47.482160 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e85f67bf-16b4-44a9-a33f-52f0e8d55e46 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:47.482638 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e85f67bf-16b4-44a9-a33f-52f0e8d55e46 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:47.630593 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e85f67bf-16b4-44a9-a33f-52f0e8d55e46 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:47.639147 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e85f67bf-16b4-44a9-a33f-52f0e8d55e46 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1676 microversion: 2.1 time: 0.169763 May 13 13:26:47.639722 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 251/494] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:47 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:48.656031 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-23b3dd69-e2cd-4835-8ab7-60a5d250741e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:48.656601 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-23b3dd69-e2cd-4835-8ab7-60a5d250741e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:48.662979 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-23b3dd69-e2cd-4835-8ab7-60a5d250741e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:48.663407 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-23b3dd69-e2cd-4835-8ab7-60a5d250741e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:48.664164 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-23b3dd69-e2cd-4835-8ab7-60a5d250741e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:48.664600 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-23b3dd69-e2cd-4835-8ab7-60a5d250741e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:48.795604 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-23b3dd69-e2cd-4835-8ab7-60a5d250741e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:48.803605 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-23b3dd69-e2cd-4835-8ab7-60a5d250741e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1676 microversion: 2.1 time: 0.151298 May 13 13:26:48.807608 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 244/495] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:48 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:49.821955 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e2a649d8-2452-48a7-8e2f-d185127199a3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:49.822583 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e2a649d8-2452-48a7-8e2f-d185127199a3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:49.829543 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e2a649d8-2452-48a7-8e2f-d185127199a3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:49.829999 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e2a649d8-2452-48a7-8e2f-d185127199a3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:49.830767 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e2a649d8-2452-48a7-8e2f-d185127199a3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:49.831194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e2a649d8-2452-48a7-8e2f-d185127199a3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:49.964482 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e2a649d8-2452-48a7-8e2f-d185127199a3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:49.972310 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e2a649d8-2452-48a7-8e2f-d185127199a3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1676 microversion: 2.1 time: 0.154249 May 13 13:26:49.972875 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 252/496] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:49 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:50.990293 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c7e7d68b-3ac5-4d94-ba30-1df5814e905a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:50.990904 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c7e7d68b-3ac5-4d94-ba30-1df5814e905a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:50.997263 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c7e7d68b-3ac5-4d94-ba30-1df5814e905a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:50.997709 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c7e7d68b-3ac5-4d94-ba30-1df5814e905a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:50.998538 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c7e7d68b-3ac5-4d94-ba30-1df5814e905a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:50.998975 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c7e7d68b-3ac5-4d94-ba30-1df5814e905a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:51.131036 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c7e7d68b-3ac5-4d94-ba30-1df5814e905a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:51.139653 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c7e7d68b-3ac5-4d94-ba30-1df5814e905a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1676 microversion: 2.1 time: 0.153261 May 13 13:26:51.140224 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 245/497] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:50 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:51.188731 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-969537f0-ec75-40bc-a8dd-579ae3f8e1d0 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe934b4a-f4cf-4a6f-9853-00dc7081a0d1"}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:26:51.189865 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-969537f0-ec75-40bc-a8dd-579ae3f8e1d0 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:51.196641 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-969537f0-ec75-40bc-a8dd-579ae3f8e1d0 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:51.197085 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-969537f0-ec75-40bc-a8dd-579ae3f8e1d0 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:51.197902 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-969537f0-ec75-40bc-a8dd-579ae3f8e1d0 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:51.198370 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-969537f0-ec75-40bc-a8dd-579ae3f8e1d0 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:52.080782 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-969537f0-ec75-40bc-a8dd-579ae3f8e1d0 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "POST /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.897963 May 13 13:26:52.081396 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 253/498] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 13 13:26:51 2022] POST /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686/os-volume_attachments => generated 194 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:26:52.157843 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-915cbcc9-c963-4d41-bdf9-4b7f38eee1c2 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:52.158487 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-915cbcc9-c963-4d41-bdf9-4b7f38eee1c2 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:52.165070 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-915cbcc9-c963-4d41-bdf9-4b7f38eee1c2 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:52.165518 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-915cbcc9-c963-4d41-bdf9-4b7f38eee1c2 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:52.166304 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-915cbcc9-c963-4d41-bdf9-4b7f38eee1c2 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:52.166735 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-915cbcc9-c963-4d41-bdf9-4b7f38eee1c2 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:52.301119 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-915cbcc9-c963-4d41-bdf9-4b7f38eee1c2 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:52.308441 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-915cbcc9-c963-4d41-bdf9-4b7f38eee1c2 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1676 microversion: 2.1 time: 0.155308 May 13 13:26:52.309630 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 246/499] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:52 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:53.327685 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1c41766a-42e2-4001-9734-1c24c55d917e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:53.328345 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1c41766a-42e2-4001-9734-1c24c55d917e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:53.334544 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1c41766a-42e2-4001-9734-1c24c55d917e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:53.334993 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1c41766a-42e2-4001-9734-1c24c55d917e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:53.335757 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1c41766a-42e2-4001-9734-1c24c55d917e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:53.336190 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1c41766a-42e2-4001-9734-1c24c55d917e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:53.475490 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1c41766a-42e2-4001-9734-1c24c55d917e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:53.483201 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1c41766a-42e2-4001-9734-1c24c55d917e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1676 microversion: 2.1 time: 0.160717 May 13 13:26:53.483840 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 254/500] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:53 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:54.500406 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b06aedc4-3d89-41ee-bbc7-df31276eed35 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:54.501000 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b06aedc4-3d89-41ee-bbc7-df31276eed35 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:54.507556 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b06aedc4-3d89-41ee-bbc7-df31276eed35 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:54.508006 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b06aedc4-3d89-41ee-bbc7-df31276eed35 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:54.508782 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b06aedc4-3d89-41ee-bbc7-df31276eed35 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:54.509218 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b06aedc4-3d89-41ee-bbc7-df31276eed35 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:54.638323 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b06aedc4-3d89-41ee-bbc7-df31276eed35 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:54.645638 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b06aedc4-3d89-41ee-bbc7-df31276eed35 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1676 microversion: 2.1 time: 0.149627 May 13 13:26:54.646206 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 247/501] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:54 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:55.662522 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4e7a26b5-1e97-435b-96af-87b91085ae1e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:55.663108 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4e7a26b5-1e97-435b-96af-87b91085ae1e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:55.669600 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4e7a26b5-1e97-435b-96af-87b91085ae1e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:55.669955 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4e7a26b5-1e97-435b-96af-87b91085ae1e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:55.670737 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4e7a26b5-1e97-435b-96af-87b91085ae1e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:55.671161 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4e7a26b5-1e97-435b-96af-87b91085ae1e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:55.801125 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4e7a26b5-1e97-435b-96af-87b91085ae1e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:55.808418 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4e7a26b5-1e97-435b-96af-87b91085ae1e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1676 microversion: 2.1 time: 0.149790 May 13 13:26:55.809559 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 255/502] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:55 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:56.826258 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-bc212db1-96e3-4611-adaf-982fea800ae1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:56.826914 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-bc212db1-96e3-4611-adaf-982fea800ae1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:56.833873 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bc212db1-96e3-4611-adaf-982fea800ae1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:56.834357 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bc212db1-96e3-4611-adaf-982fea800ae1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:56.835125 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bc212db1-96e3-4611-adaf-982fea800ae1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:56.835587 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bc212db1-96e3-4611-adaf-982fea800ae1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:56.968122 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-bc212db1-96e3-4611-adaf-982fea800ae1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:56.975359 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-bc212db1-96e3-4611-adaf-982fea800ae1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1676 microversion: 2.1 time: 0.153137 May 13 13:26:56.975921 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 248/503] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:56 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:57.992659 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4c33f2fc-e334-4e3a-940a-5243d3f8be08 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:57.993263 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4c33f2fc-e334-4e3a-940a-5243d3f8be08 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:57.999669 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4c33f2fc-e334-4e3a-940a-5243d3f8be08 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:58.000119 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4c33f2fc-e334-4e3a-940a-5243d3f8be08 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:58.000879 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4c33f2fc-e334-4e3a-940a-5243d3f8be08 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:58.001313 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4c33f2fc-e334-4e3a-940a-5243d3f8be08 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:58.130096 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4c33f2fc-e334-4e3a-940a-5243d3f8be08 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:58.138071 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4c33f2fc-e334-4e3a-940a-5243d3f8be08 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1676 microversion: 2.1 time: 0.149060 May 13 13:26:58.138728 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 256/504] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:57 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:59.154509 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ac2c764c-e2f1-4b74-ac5c-206c4d1f9b24 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:59.155041 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ac2c764c-e2f1-4b74-ac5c-206c4d1f9b24 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:59.161392 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ac2c764c-e2f1-4b74-ac5c-206c4d1f9b24 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:59.161846 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ac2c764c-e2f1-4b74-ac5c-206c4d1f9b24 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:59.162695 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ac2c764c-e2f1-4b74-ac5c-206c4d1f9b24 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:59.163126 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ac2c764c-e2f1-4b74-ac5c-206c4d1f9b24 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:59.293831 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ac2c764c-e2f1-4b74-ac5c-206c4d1f9b24 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:59.302129 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ac2c764c-e2f1-4b74-ac5c-206c4d1f9b24 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1676 microversion: 2.1 time: 0.151655 May 13 13:26:59.308396 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 249/505] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:26:59 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:00.319616 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-44e96e18-262e-4297-962d-4848190032ae tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:00.320136 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-44e96e18-262e-4297-962d-4848190032ae tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:00.326960 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-44e96e18-262e-4297-962d-4848190032ae tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:00.327970 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-44e96e18-262e-4297-962d-4848190032ae tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:00.328751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-44e96e18-262e-4297-962d-4848190032ae tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:00.329188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-44e96e18-262e-4297-962d-4848190032ae tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:00.462625 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-44e96e18-262e-4297-962d-4848190032ae tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:00.470678 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-44e96e18-262e-4297-962d-4848190032ae tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1653 microversion: 2.1 time: 0.154893 May 13 13:27:00.471382 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 257/506] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:00 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1653 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:00.487873 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-706542b6-d217-49ff-9736-579f9be45afd tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:00.494977 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-706542b6-d217-49ff-9736-579f9be45afd tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:00.495215 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-706542b6-d217-49ff-9736-579f9be45afd tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:00.556746 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-706542b6-d217-49ff-9736-579f9be45afd tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Going to try to start instance {{(pid=117720) start /opt/stack/nova/nova/compute/api.py:2730}} May 13 13:27:00.618118 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f171c759-b854-4de7-a0a1-bc104de184b5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:00.619077 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f171c759-b854-4de7-a0a1-bc104de184b5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:00.625782 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f171c759-b854-4de7-a0a1-bc104de184b5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:00.629707 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f171c759-b854-4de7-a0a1-bc104de184b5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:00.629707 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f171c759-b854-4de7-a0a1-bc104de184b5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:00.629707 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f171c759-b854-4de7-a0a1-bc104de184b5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:00.650226 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-f171c759-b854-4de7-a0a1-bc104de184b5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lazy-loading 'flavor' on Instance uuid ba162312-5c53-4320-acc9-4e2566f27686 {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:27:00.768559 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-706542b6-d217-49ff-9736-579f9be45afd tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "POST /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86/action" status: 202 len: 0 microversion: 2.1 time: 0.284146 May 13 13:27:00.775546 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 250/507] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 13 13:27:00 2022] POST /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:27:00.783735 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ab277620-1aa5-4b44-962b-a9999a2edd95 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:00.784554 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ab277620-1aa5-4b44-962b-a9999a2edd95 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:00.790903 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ab277620-1aa5-4b44-962b-a9999a2edd95 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:00.791349 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ab277620-1aa5-4b44-962b-a9999a2edd95 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:00.792117 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ab277620-1aa5-4b44-962b-a9999a2edd95 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:00.792549 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ab277620-1aa5-4b44-962b-a9999a2edd95 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:00.932779 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ab277620-1aa5-4b44-962b-a9999a2edd95 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:00.941002 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ab277620-1aa5-4b44-962b-a9999a2edd95 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1662 microversion: 2.1 time: 0.162204 May 13 13:27:00.941764 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 251/508] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:00 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1662 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:01.033143 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f171c759-b854-4de7-a0a1-bc104de184b5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "POST /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686/action" status: 200 len: 32 microversion: 2.1 time: 0.418141 May 13 13:27:01.038434 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 258/509] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 13 13:27:00 2022] POST /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686/action => generated 32 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 13:27:01.047939 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b06ce2d0-7937-4c65-bdf8-a675bf371280 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:01.049113 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b06ce2d0-7937-4c65-bdf8-a675bf371280 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:01.057057 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b06ce2d0-7937-4c65-bdf8-a675bf371280 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:01.057576 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b06ce2d0-7937-4c65-bdf8-a675bf371280 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:01.058510 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b06ce2d0-7937-4c65-bdf8-a675bf371280 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:01.059094 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b06ce2d0-7937-4c65-bdf8-a675bf371280 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:01.198729 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b06ce2d0-7937-4c65-bdf8-a675bf371280 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:01.208167 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b06ce2d0-7937-4c65-bdf8-a675bf371280 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1735 microversion: 2.1 time: 0.168151 May 13 13:27:01.208750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 252/510] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:01 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:01.959175 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-72225fe5-7f1f-4112-9540-74b5f7a3b43c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:01.959862 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-72225fe5-7f1f-4112-9540-74b5f7a3b43c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:01.966267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72225fe5-7f1f-4112-9540-74b5f7a3b43c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:01.967602 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72225fe5-7f1f-4112-9540-74b5f7a3b43c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:01.968363 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72225fe5-7f1f-4112-9540-74b5f7a3b43c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:01.968789 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72225fe5-7f1f-4112-9540-74b5f7a3b43c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:02.113771 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-72225fe5-7f1f-4112-9540-74b5f7a3b43c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:02.122098 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-72225fe5-7f1f-4112-9540-74b5f7a3b43c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1662 microversion: 2.1 time: 0.167556 May 13 13:27:02.122798 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 259/511] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:01 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1662 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:02.226396 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0820a843-8803-432b-af14-d7b9877c5d4e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:02.227004 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0820a843-8803-432b-af14-d7b9877c5d4e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:02.234321 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0820a843-8803-432b-af14-d7b9877c5d4e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:02.235037 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0820a843-8803-432b-af14-d7b9877c5d4e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:02.236108 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0820a843-8803-432b-af14-d7b9877c5d4e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:02.236358 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0820a843-8803-432b-af14-d7b9877c5d4e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:02.367110 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0820a843-8803-432b-af14-d7b9877c5d4e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:02.375535 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0820a843-8803-432b-af14-d7b9877c5d4e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1735 microversion: 2.1 time: 0.152934 May 13 13:27:02.376108 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 253/512] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:02 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:03.145481 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3f7abe94-387a-4588-b116-52c1bc1cdb03 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:03.146183 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3f7abe94-387a-4588-b116-52c1bc1cdb03 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:03.152843 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3f7abe94-387a-4588-b116-52c1bc1cdb03 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:03.153288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3f7abe94-387a-4588-b116-52c1bc1cdb03 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:03.154586 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3f7abe94-387a-4588-b116-52c1bc1cdb03 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:03.155018 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3f7abe94-387a-4588-b116-52c1bc1cdb03 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:03.294080 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3f7abe94-387a-4588-b116-52c1bc1cdb03 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:03.302918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3f7abe94-387a-4588-b116-52c1bc1cdb03 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1666 microversion: 2.1 time: 0.161297 May 13 13:27:03.303562 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 260/513] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:03 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1666 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:03.392849 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-80796957-6c41-4b3c-a53b-2b07b3d30f69 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:03.393467 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-80796957-6c41-4b3c-a53b-2b07b3d30f69 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:03.400104 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-80796957-6c41-4b3c-a53b-2b07b3d30f69 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:03.400475 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-80796957-6c41-4b3c-a53b-2b07b3d30f69 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:03.401255 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-80796957-6c41-4b3c-a53b-2b07b3d30f69 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:03.401681 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-80796957-6c41-4b3c-a53b-2b07b3d30f69 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:03.542968 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-80796957-6c41-4b3c-a53b-2b07b3d30f69 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:03.550996 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-80796957-6c41-4b3c-a53b-2b07b3d30f69 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1735 microversion: 2.1 time: 0.161994 May 13 13:27:03.551578 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 254/514] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:03 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:04.567583 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f88d3622-2e74-49e2-9726-bc266d1e239d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:04.568710 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f88d3622-2e74-49e2-9726-bc266d1e239d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:04.575293 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f88d3622-2e74-49e2-9726-bc266d1e239d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:04.576562 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f88d3622-2e74-49e2-9726-bc266d1e239d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:04.577766 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f88d3622-2e74-49e2-9726-bc266d1e239d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:04.578619 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f88d3622-2e74-49e2-9726-bc266d1e239d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:04.714944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f88d3622-2e74-49e2-9726-bc266d1e239d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:04.727118 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f88d3622-2e74-49e2-9726-bc266d1e239d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1735 microversion: 2.1 time: 0.163144 May 13 13:27:04.727691 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 261/515] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:04 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:05.743873 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-10217cad-f041-444c-ab23-39a4e5f23dca tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:05.744486 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-10217cad-f041-444c-ab23-39a4e5f23dca tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:05.751716 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-10217cad-f041-444c-ab23-39a4e5f23dca tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:05.752159 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-10217cad-f041-444c-ab23-39a4e5f23dca tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:05.752923 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-10217cad-f041-444c-ab23-39a4e5f23dca tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:05.753347 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-10217cad-f041-444c-ab23-39a4e5f23dca tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:05.887122 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-10217cad-f041-444c-ab23-39a4e5f23dca tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:05.895908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-10217cad-f041-444c-ab23-39a4e5f23dca tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1735 microversion: 2.1 time: 0.155986 May 13 13:27:05.896466 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 255/516] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:05 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:06.913553 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-68774477-3008-4ede-968d-430391851a5f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:06.914153 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-68774477-3008-4ede-968d-430391851a5f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:06.921154 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-68774477-3008-4ede-968d-430391851a5f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:06.921590 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-68774477-3008-4ede-968d-430391851a5f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:06.922379 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-68774477-3008-4ede-968d-430391851a5f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:06.922810 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-68774477-3008-4ede-968d-430391851a5f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:07.056860 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-68774477-3008-4ede-968d-430391851a5f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:07.065105 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-68774477-3008-4ede-968d-430391851a5f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1735 microversion: 2.1 time: 0.155368 May 13 13:27:07.065779 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 262/517] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:06 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:08.084047 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-725ba3fb-269d-4aeb-b897-e79324e4fada tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:08.084681 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-725ba3fb-269d-4aeb-b897-e79324e4fada tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:08.091524 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-725ba3fb-269d-4aeb-b897-e79324e4fada tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:08.091974 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-725ba3fb-269d-4aeb-b897-e79324e4fada tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:08.092760 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-725ba3fb-269d-4aeb-b897-e79324e4fada tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:08.093196 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-725ba3fb-269d-4aeb-b897-e79324e4fada tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:08.237075 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-725ba3fb-269d-4aeb-b897-e79324e4fada tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:08.244852 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-725ba3fb-269d-4aeb-b897-e79324e4fada tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1735 microversion: 2.1 time: 0.164671 May 13 13:27:08.245414 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 256/518] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:08 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:09.266168 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f3a595e3-5997-48b4-bfa1-7b1e1bb9019f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:09.266795 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f3a595e3-5997-48b4-bfa1-7b1e1bb9019f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:09.273293 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f3a595e3-5997-48b4-bfa1-7b1e1bb9019f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:09.273741 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f3a595e3-5997-48b4-bfa1-7b1e1bb9019f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:09.274561 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f3a595e3-5997-48b4-bfa1-7b1e1bb9019f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:09.274997 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f3a595e3-5997-48b4-bfa1-7b1e1bb9019f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:09.413504 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f3a595e3-5997-48b4-bfa1-7b1e1bb9019f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:09.422484 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f3a595e3-5997-48b4-bfa1-7b1e1bb9019f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1735 microversion: 2.1 time: 0.161315 May 13 13:27:09.423089 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 263/519] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:09 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:10.439750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-793b2b2d-553c-4074-8eca-f9f2745fd247 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:10.440355 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-793b2b2d-553c-4074-8eca-f9f2745fd247 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:10.446761 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-793b2b2d-553c-4074-8eca-f9f2745fd247 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:10.447202 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-793b2b2d-553c-4074-8eca-f9f2745fd247 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:10.447956 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-793b2b2d-553c-4074-8eca-f9f2745fd247 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:10.448383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-793b2b2d-553c-4074-8eca-f9f2745fd247 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:10.582303 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-793b2b2d-553c-4074-8eca-f9f2745fd247 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:10.590795 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-793b2b2d-553c-4074-8eca-f9f2745fd247 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1735 microversion: 2.1 time: 0.154894 May 13 13:27:10.592154 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 257/520] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:10 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:11.611760 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7a92f8db-14a4-4c19-95cc-39cacde9a5eb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:11.612507 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7a92f8db-14a4-4c19-95cc-39cacde9a5eb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:11.619035 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7a92f8db-14a4-4c19-95cc-39cacde9a5eb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:11.619497 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7a92f8db-14a4-4c19-95cc-39cacde9a5eb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:11.620403 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7a92f8db-14a4-4c19-95cc-39cacde9a5eb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:11.620841 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7a92f8db-14a4-4c19-95cc-39cacde9a5eb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:11.756062 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7a92f8db-14a4-4c19-95cc-39cacde9a5eb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:11.764045 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7a92f8db-14a4-4c19-95cc-39cacde9a5eb tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1735 microversion: 2.1 time: 0.159072 May 13 13:27:11.764618 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 264/521] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:11 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:12.781736 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e36f2d03-d6d9-41df-8aef-e9ca40bc0e9c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:12.787800 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e36f2d03-d6d9-41df-8aef-e9ca40bc0e9c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:12.800351 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e36f2d03-d6d9-41df-8aef-e9ca40bc0e9c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:12.800796 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e36f2d03-d6d9-41df-8aef-e9ca40bc0e9c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:12.801580 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e36f2d03-d6d9-41df-8aef-e9ca40bc0e9c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:12.802009 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e36f2d03-d6d9-41df-8aef-e9ca40bc0e9c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:12.991354 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e36f2d03-d6d9-41df-8aef-e9ca40bc0e9c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:13.000497 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e36f2d03-d6d9-41df-8aef-e9ca40bc0e9c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1735 microversion: 2.1 time: 0.222705 May 13 13:27:13.001161 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 258/522] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:12 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:14.018833 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e682027d-5f66-41dd-8c7f-50549529b6b9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:14.019683 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e682027d-5f66-41dd-8c7f-50549529b6b9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:14.026135 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e682027d-5f66-41dd-8c7f-50549529b6b9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:14.026509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e682027d-5f66-41dd-8c7f-50549529b6b9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:14.027278 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e682027d-5f66-41dd-8c7f-50549529b6b9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:14.027746 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e682027d-5f66-41dd-8c7f-50549529b6b9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:14.192984 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e682027d-5f66-41dd-8c7f-50549529b6b9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:14.201540 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e682027d-5f66-41dd-8c7f-50549529b6b9 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1735 microversion: 2.1 time: 0.186013 May 13 13:27:14.202079 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 265/523] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:14 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:15.219798 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f23d51f2-3d63-41b6-9a0c-7a715a0bb4a5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:15.220403 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f23d51f2-3d63-41b6-9a0c-7a715a0bb4a5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:15.226573 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f23d51f2-3d63-41b6-9a0c-7a715a0bb4a5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:15.227019 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f23d51f2-3d63-41b6-9a0c-7a715a0bb4a5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:15.227783 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f23d51f2-3d63-41b6-9a0c-7a715a0bb4a5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:15.228214 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f23d51f2-3d63-41b6-9a0c-7a715a0bb4a5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:15.484002 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f23d51f2-3d63-41b6-9a0c-7a715a0bb4a5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:15.492229 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f23d51f2-3d63-41b6-9a0c-7a715a0bb4a5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1735 microversion: 2.1 time: 0.276898 May 13 13:27:15.493500 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 259/524] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:15 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1735 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:16.510875 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e5dbf6ef-cfd7-47ea-965e-d92ab351f0b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:16.512614 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e5dbf6ef-cfd7-47ea-965e-d92ab351f0b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:16.521025 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e5dbf6ef-cfd7-47ea-965e-d92ab351f0b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:16.521867 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e5dbf6ef-cfd7-47ea-965e-d92ab351f0b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:16.522902 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e5dbf6ef-cfd7-47ea-965e-d92ab351f0b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:16.523551 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e5dbf6ef-cfd7-47ea-965e-d92ab351f0b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:16.748438 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e5dbf6ef-cfd7-47ea-965e-d92ab351f0b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:16.757398 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e5dbf6ef-cfd7-47ea-965e-d92ab351f0b1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1735 microversion: 2.1 time: 0.250294 May 13 13:27:16.763017 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 266/525] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:16 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1735 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:17.775513 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-486f49f4-28b5-427f-bd98-4e945b17617e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:17.776028 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-486f49f4-28b5-427f-bd98-4e945b17617e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:17.783625 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-486f49f4-28b5-427f-bd98-4e945b17617e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:17.784085 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-486f49f4-28b5-427f-bd98-4e945b17617e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:17.784873 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-486f49f4-28b5-427f-bd98-4e945b17617e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:17.785313 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-486f49f4-28b5-427f-bd98-4e945b17617e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:18.019908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-486f49f4-28b5-427f-bd98-4e945b17617e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:18.031973 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-486f49f4-28b5-427f-bd98-4e945b17617e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1735 microversion: 2.1 time: 0.260366 May 13 13:27:18.032575 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 260/526] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:17 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1735 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:19.049592 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e78332cb-b44f-417f-a450-48c4e2917714 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:19.050190 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e78332cb-b44f-417f-a450-48c4e2917714 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:19.058371 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e78332cb-b44f-417f-a450-48c4e2917714 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:19.058371 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e78332cb-b44f-417f-a450-48c4e2917714 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:19.058371 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e78332cb-b44f-417f-a450-48c4e2917714 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:19.058697 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e78332cb-b44f-417f-a450-48c4e2917714 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:19.198876 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e78332cb-b44f-417f-a450-48c4e2917714 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:19.209439 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e78332cb-b44f-417f-a450-48c4e2917714 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1735 microversion: 2.1 time: 0.163320 May 13 13:27:19.210028 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 267/527] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:19 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:19.726056 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8970a4c8-4588-4907-a864-1a6833c11b1f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:19.726648 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8970a4c8-4588-4907-a864-1a6833c11b1f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:19.733001 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8970a4c8-4588-4907-a864-1a6833c11b1f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:19.733438 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8970a4c8-4588-4907-a864-1a6833c11b1f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:19.734221 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8970a4c8-4588-4907-a864-1a6833c11b1f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:19.734668 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8970a4c8-4588-4907-a864-1a6833c11b1f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:19.766598 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8970a4c8-4588-4907-a864-1a6833c11b1f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6/os-volume_attachments/835d7358-d20e-463c-af16-eaf718c1c967" status: 200 len: 194 microversion: 2.20 time: 0.044475 May 13 13:27:19.767261 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 261/528] 10.222.0.13 () {60 vars in 1453 bytes} [Fri May 13 13:27:19 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6/os-volume_attachments/835d7358-d20e-463c-af16-eaf718c1c967 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:27:19.835561 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-824c278e-136e-4cf5-9432-21035989ec10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:19.836051 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-824c278e-136e-4cf5-9432-21035989ec10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:19.844161 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-824c278e-136e-4cf5-9432-21035989ec10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:19.845106 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-824c278e-136e-4cf5-9432-21035989ec10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:19.845421 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-824c278e-136e-4cf5-9432-21035989ec10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:19.845825 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-824c278e-136e-4cf5-9432-21035989ec10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:19.958112 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-824c278e-136e-4cf5-9432-21035989ec10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lazy-loading 'services' on Instance uuid 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:27:20.184245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-824c278e-136e-4cf5-9432-21035989ec10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6/os-volume_attachments/835d7358-d20e-463c-af16-eaf718c1c967" status: 202 len: 0 microversion: 2.20 time: 0.352930 May 13 13:27:20.193648 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 268/529] 10.222.0.13 () {60 vars in 1456 bytes} [Fri May 13 13:27:19 2022] DELETE /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6/os-volume_attachments/835d7358-d20e-463c-af16-eaf718c1c967 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 13:27:20.195660 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8443e014-2138-4009-b884-1f4d616b153c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:20.196738 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8443e014-2138-4009-b884-1f4d616b153c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:20.207357 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8443e014-2138-4009-b884-1f4d616b153c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:20.207811 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8443e014-2138-4009-b884-1f4d616b153c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:20.208597 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8443e014-2138-4009-b884-1f4d616b153c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:20.209036 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8443e014-2138-4009-b884-1f4d616b153c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:20.230926 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b42da37f-e894-4054-9a53-54277995a5c1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:20.232428 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b42da37f-e894-4054-9a53-54277995a5c1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:20.240969 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b42da37f-e894-4054-9a53-54277995a5c1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:20.241790 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b42da37f-e894-4054-9a53-54277995a5c1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:20.243406 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b42da37f-e894-4054-9a53-54277995a5c1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:20.244183 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b42da37f-e894-4054-9a53-54277995a5c1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:20.257042 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8443e014-2138-4009-b884-1f4d616b153c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066685 May 13 13:27:20.257619 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 262/530] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 13 13:27:20 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:27:20.415256 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b42da37f-e894-4054-9a53-54277995a5c1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:20.424987 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b42da37f-e894-4054-9a53-54277995a5c1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1735 microversion: 2.1 time: 0.199161 May 13 13:27:20.434535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 269/531] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:20 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:21.269624 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-bf3eac0a-1b51-4a8a-9757-b6e787d9668d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:21.271422 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-bf3eac0a-1b51-4a8a-9757-b6e787d9668d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:21.279814 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bf3eac0a-1b51-4a8a-9757-b6e787d9668d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:21.280651 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bf3eac0a-1b51-4a8a-9757-b6e787d9668d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:21.281439 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bf3eac0a-1b51-4a8a-9757-b6e787d9668d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:21.282037 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bf3eac0a-1b51-4a8a-9757-b6e787d9668d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:21.316982 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-bf3eac0a-1b51-4a8a-9757-b6e787d9668d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051285 May 13 13:27:21.319557 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 263/532] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 13 13:27:21 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:27:21.441053 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cd24d394-817e-40cd-a341-a3f00f6af1d8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:21.442352 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-cd24d394-817e-40cd-a341-a3f00f6af1d8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:21.449897 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cd24d394-817e-40cd-a341-a3f00f6af1d8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:21.450380 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cd24d394-817e-40cd-a341-a3f00f6af1d8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:21.451931 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cd24d394-817e-40cd-a341-a3f00f6af1d8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:21.452375 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cd24d394-817e-40cd-a341-a3f00f6af1d8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:21.719041 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-cd24d394-817e-40cd-a341-a3f00f6af1d8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:21.733301 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-cd24d394-817e-40cd-a341-a3f00f6af1d8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1715 microversion: 2.1 time: 0.296014 May 13 13:27:21.746504 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 270/533] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:21 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1715 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:21.853401 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7e518613-a385-4bfc-8674-2b00bea2d007 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:21.853987 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7e518613-a385-4bfc-8674-2b00bea2d007 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:21.864875 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7e518613-a385-4bfc-8674-2b00bea2d007 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:21.876517 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7e518613-a385-4bfc-8674-2b00bea2d007 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:21.876517 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7e518613-a385-4bfc-8674-2b00bea2d007 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:21.876517 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7e518613-a385-4bfc-8674-2b00bea2d007 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:22.026349 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-7e518613-a385-4bfc-8674-2b00bea2d007 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] HTTP exception thrown: Cannot 'detach_volume' instance ba162312-5c53-4320-acc9-4e2566f27686 while it is in vm_state rescued May 13 13:27:22.028185 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7e518613-a385-4bfc-8674-2b00bea2d007 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Request method failure captured: May 13 13:27:22.028185 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: request: DELETE /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686/os-volume_attachments/fe934b4a-f4cf-4a6f-9853-00dc7081a0d1 HTTP/1.1 May 13 13:27:22.028185 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept: application/json May 13 13:27:22.028185 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity May 13 13:27:22.028185 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Connection: close May 13 13:27:22.028185 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Length: 0 May 13 13:27:22.028185 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Type: application/json May 13 13:27:22.028185 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Host: 10.222.0.13 May 13 13:27:22.028185 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None May 13 13:27:22.028185 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 May 13 13:27:22.028185 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiflu9j1w3aWMYNeaepMtfghSN45R1rpudn7y88iUBZfUo5TNiFrmf5PObcCzu3o7oE_Enr4-R9iUAQxm1SnylSai1-YY48Gzh5RYsKm6vqseENGLkqnAve6m4Gli7NdrEPkNnXAnVdgHIyQUn7lwQz8bRkj2auUPtcvSEbefYCErLs1g May 13 13:27:22.028185 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Id: None May 13 13:27:22.028185 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Name: None May 13 13:27:22.028185 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed May 13 13:27:22.028185 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True May 13 13:27:22.028185 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default May 13 13:27:22.028185 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default May 13 13:27:22.028185 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Id: a0e165a1f0d34fca81de45a48c6cdbb9 May 13 13:27:22.028185 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2055800790 May 13 13:27:22.028185 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Role: member,reader May 13 13:27:22.028185 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Roles: member,reader May 13 13:27:22.032841 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a0e165a1f0d34fca81de45a48c6cdbb9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a0e165a1f0d34fca81de45a48c6cdbb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a0e165a1f0d34fca81de45a48c6cdbb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a0e165a1f0d34fca81de45a48c6cdbb9"}]}] May 13 13:27:22.032841 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2055800790 May 13 13:27:22.032841 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Id: a0e165a1f0d34fca81de45a48c6cdbb9 May 13 13:27:22.032841 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2055800790 May 13 13:27:22.032841 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User: tempest-ServerRescueNegativeTestJSON-2055800790-project May 13 13:27:22.032841 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default May 13 13:27:22.032841 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default May 13 13:27:22.032841 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Id: 805e8e6c39f94d3bbcf60930492e297c May 13 13:27:22.032841 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2055800790-project May 13 13:27:22.032841 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: method: > May 13 13:27:22.032841 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: exception: Cannot 'detach_volume' instance ba162312-5c53-4320-acc9-4e2566f27686 while it is in vm_state rescued May 13 13:27:22.033785 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: action_args: {'server_id': 'ba162312-5c53-4320-acc9-4e2566f27686', 'id': 'fe934b4a-f4cf-4a6f-9853-00dc7081a0d1'} May 13 13:27:22.033785 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:27:22.033785 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:27:22.033785 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 13 13:27:22.033785 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 13 13:27:22.033785 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 13:27:22.033785 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 13:27:22.033785 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 13 13:27:22.033785 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 13 13:27:22.033785 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ba162312-5c53-4320-acc9-4e2566f27686 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 13 13:27:22.033785 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:27:22.033785 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:27:22.033785 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:27:22.033785 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:27:22.033785 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:27:22.033785 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:27:22.033785 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:27:22.033785 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:27:22.033785 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:27:22.033785 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:27:22.035397 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 13 13:27:22.035397 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 13 13:27:22.035397 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 13 13:27:22.035397 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 13 13:27:22.035397 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ba162312-5c53-4320-acc9-4e2566f27686 while it is in vm_state rescued May 13 13:27:22.035397 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:27:22.035397 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:27:22.035397 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:27:22.035397 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:27:22.035397 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:27:22.035397 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:27:22.035397 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:27:22.035397 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:27:22.035397 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ba162312-5c53-4320-acc9-4e2566f27686 while it is in vm_state rescued May 13 13:27:22.035397 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:27:22.035397 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7e518613-a385-4bfc-8674-2b00bea2d007 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Returning 409 to user: Cannot 'detach_volume' instance ba162312-5c53-4320-acc9-4e2566f27686 while it is in vm_state rescued {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:27:22.038146 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7e518613-a385-4bfc-8674-2b00bea2d007 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686/os-volume_attachments/fe934b4a-f4cf-4a6f-9853-00dc7081a0d1" status: 409 len: 152 microversion: 2.1 time: 0.182819 May 13 13:27:22.038901 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 264/534] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 13 13:27:21 2022] DELETE /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686/os-volume_attachments/fe934b4a-f4cf-4a6f-9853-00dc7081a0d1 => generated 152 bytes in 190 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 13 13:27:22.048311 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-49343eff-e28e-4800-a3d8-717c5edacd44 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:22.048984 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-49343eff-e28e-4800-a3d8-717c5edacd44 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:22.056678 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-49343eff-e28e-4800-a3d8-717c5edacd44 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:22.057235 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-49343eff-e28e-4800-a3d8-717c5edacd44 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:22.058167 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-49343eff-e28e-4800-a3d8-717c5edacd44 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:22.058725 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-49343eff-e28e-4800-a3d8-717c5edacd44 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:22.281232 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-49343eff-e28e-4800-a3d8-717c5edacd44 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "POST /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686/action" status: 202 len: 0 microversion: 2.1 time: 0.234291 May 13 13:27:22.293510 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-fd6f5757-cdb2-487c-9803-dc6a8400fcc4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:22.295497 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-fd6f5757-cdb2-487c-9803-dc6a8400fcc4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:22.297990 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 271/535] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 13 13:27:22 2022] POST /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:27:22.308930 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd6f5757-cdb2-487c-9803-dc6a8400fcc4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:22.309757 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd6f5757-cdb2-487c-9803-dc6a8400fcc4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:22.310980 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd6f5757-cdb2-487c-9803-dc6a8400fcc4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:22.311688 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd6f5757-cdb2-487c-9803-dc6a8400fcc4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:22.329408 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f446c914-939c-4daf-addf-99d6f3dc1063 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:22.331311 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f446c914-939c-4daf-addf-99d6f3dc1063 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:22.338754 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f446c914-939c-4daf-addf-99d6f3dc1063 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:22.341980 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f446c914-939c-4daf-addf-99d6f3dc1063 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:22.343135 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f446c914-939c-4daf-addf-99d6f3dc1063 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:22.343772 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f446c914-939c-4daf-addf-99d6f3dc1063 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:22.391235 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f446c914-939c-4daf-addf-99d6f3dc1063 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.066654 May 13 13:27:22.392548 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 272/536] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 13 13:27:22 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:22.477231 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-155be5dc-1c87-4972-ba7e-abb7b5b6854c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:22.478505 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-155be5dc-1c87-4972-ba7e-abb7b5b6854c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:22.487744 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-155be5dc-1c87-4972-ba7e-abb7b5b6854c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:22.488500 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-155be5dc-1c87-4972-ba7e-abb7b5b6854c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:22.489679 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-155be5dc-1c87-4972-ba7e-abb7b5b6854c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:22.490816 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-155be5dc-1c87-4972-ba7e-abb7b5b6854c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:22.536931 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-155be5dc-1c87-4972-ba7e-abb7b5b6854c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Going to try to terminate instance {{(pid=117721) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:27:22.709825 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fd6f5757-cdb2-487c-9803-dc6a8400fcc4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:22.724493 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-fd6f5757-cdb2-487c-9803-dc6a8400fcc4 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1723 microversion: 2.1 time: 0.437912 May 13 13:27:22.725662 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 265/537] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:22 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1723 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:22.884674 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-155be5dc-1c87-4972-ba7e-abb7b5b6854c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 204 len: 0 microversion: 2.20 time: 0.411096 May 13 13:27:22.885875 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 273/538] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 13 13:27:22 2022] DELETE /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 13 13:27:22.895165 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-fac9633c-1c6d-4f90-908b-0fc4868f5dc3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:22.895781 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-fac9633c-1c6d-4f90-908b-0fc4868f5dc3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:22.905434 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fac9633c-1c6d-4f90-908b-0fc4868f5dc3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:22.906302 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fac9633c-1c6d-4f90-908b-0fc4868f5dc3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:22.907549 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fac9633c-1c6d-4f90-908b-0fc4868f5dc3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:22.908171 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fac9633c-1c6d-4f90-908b-0fc4868f5dc3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:23.108776 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fac9633c-1c6d-4f90-908b-0fc4868f5dc3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:23.123056 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fac9633c-1c6d-4f90-908b-0fc4868f5dc3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:23.125491 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fac9633c-1c6d-4f90-908b-0fc4868f5dc3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:23.127557 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-fac9633c-1c6d-4f90-908b-0fc4868f5dc3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1725 microversion: 2.20 time: 0.235909 May 13 13:27:23.133846 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 266/539] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:27:22 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1725 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:23.744784 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7b2a148a-e298-4cc8-a697-81184dda6de1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:23.746589 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7b2a148a-e298-4cc8-a697-81184dda6de1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:23.756541 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7b2a148a-e298-4cc8-a697-81184dda6de1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:23.756998 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7b2a148a-e298-4cc8-a697-81184dda6de1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:23.757973 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7b2a148a-e298-4cc8-a697-81184dda6de1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:23.758619 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7b2a148a-e298-4cc8-a697-81184dda6de1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:24.148207 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2d71578c-9d60-4bf0-a329-195cf3c1bd98 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:24.148944 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2d71578c-9d60-4bf0-a329-195cf3c1bd98 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:24.156127 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2d71578c-9d60-4bf0-a329-195cf3c1bd98 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:24.156565 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2d71578c-9d60-4bf0-a329-195cf3c1bd98 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:24.157375 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2d71578c-9d60-4bf0-a329-195cf3c1bd98 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:24.157809 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2d71578c-9d60-4bf0-a329-195cf3c1bd98 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:24.190179 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7b2a148a-e298-4cc8-a697-81184dda6de1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:24.198676 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7b2a148a-e298-4cc8-a697-81184dda6de1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1723 microversion: 2.1 time: 0.459082 May 13 13:27:24.202420 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 274/540] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:23 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1723 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:24.388181 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2d71578c-9d60-4bf0-a329-195cf3c1bd98 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:24.396112 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2d71578c-9d60-4bf0-a329-195cf3c1bd98 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:24.397940 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2d71578c-9d60-4bf0-a329-195cf3c1bd98 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:24.399386 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2d71578c-9d60-4bf0-a329-195cf3c1bd98 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1725 microversion: 2.20 time: 0.255414 May 13 13:27:24.400134 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 267/541] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:27:24 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1725 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:27:25.227397 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c145548c-7346-46e1-995c-46f92edbb052 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:25.228388 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c145548c-7346-46e1-995c-46f92edbb052 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:25.238895 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c145548c-7346-46e1-995c-46f92edbb052 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:25.239652 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c145548c-7346-46e1-995c-46f92edbb052 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:25.241050 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c145548c-7346-46e1-995c-46f92edbb052 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:25.241866 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c145548c-7346-46e1-995c-46f92edbb052 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:25.418636 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-76f66c7a-581e-481d-8d38-0b910700d269 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:25.421775 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-76f66c7a-581e-481d-8d38-0b910700d269 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:25.438808 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-76f66c7a-581e-481d-8d38-0b910700d269 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:25.439106 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-76f66c7a-581e-481d-8d38-0b910700d269 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:25.440157 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-76f66c7a-581e-481d-8d38-0b910700d269 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:25.440442 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-76f66c7a-581e-481d-8d38-0b910700d269 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:25.550584 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-76f66c7a-581e-481d-8d38-0b910700d269 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:25.562263 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c145548c-7346-46e1-995c-46f92edbb052 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:25.563602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-76f66c7a-581e-481d-8d38-0b910700d269 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:25.566337 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-76f66c7a-581e-481d-8d38-0b910700d269 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:25.567975 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-76f66c7a-581e-481d-8d38-0b910700d269 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1657 microversion: 2.20 time: 0.153932 May 13 13:27:25.568747 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 268/542] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:27:25 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1657 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:27:25.595937 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c145548c-7346-46e1-995c-46f92edbb052 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1723 microversion: 2.1 time: 0.378017 May 13 13:27:25.597266 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 275/543] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:25 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1723 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:25.632655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6996e82c-18f9-4807-bbf2-3ca13cea44c4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:25.633431 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6996e82c-18f9-4807-bbf2-3ca13cea44c4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:25.646146 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6996e82c-18f9-4807-bbf2-3ca13cea44c4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:25.646776 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6996e82c-18f9-4807-bbf2-3ca13cea44c4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:25.647574 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6996e82c-18f9-4807-bbf2-3ca13cea44c4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:25.648000 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6996e82c-18f9-4807-bbf2-3ca13cea44c4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:25.694692 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6996e82c-18f9-4807-bbf2-3ca13cea44c4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b/ips" status: 200 len: 148 microversion: 2.1 time: 0.063680 May 13 13:27:25.701455 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 269/544] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 13 13:27:25 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b/ips => generated 148 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:27:25.711174 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1a8551ca-a725-4c72-9091-f1b1389a79af tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce90f542-eabc-4637-b1c3-de135c942909"}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:25.719135 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1a8551ca-a725-4c72-9091-f1b1389a79af tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:25.732721 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1a8551ca-a725-4c72-9091-f1b1389a79af tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:25.735839 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1a8551ca-a725-4c72-9091-f1b1389a79af tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:25.736997 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1a8551ca-a725-4c72-9091-f1b1389a79af tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:25.737760 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1a8551ca-a725-4c72-9091-f1b1389a79af tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:25.882604 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-1a8551ca-a725-4c72-9091-f1b1389a79af tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] HTTP exception thrown: Invalid volume: volume ce90f542-eabc-4637-b1c3-de135c942909 is already attached to instances: b86888c8-bdd2-468d-a602-67b4f27fb7af May 13 13:27:25.887930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1a8551ca-a725-4c72-9091-f1b1389a79af tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Request method failure captured: May 13 13:27:25.887930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: POST /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b/os-volume_attachments HTTP/1.1 May 13 13:27:25.887930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:27:25.887930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:27:25.887930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:27:25.887930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 74 May 13 13:27:25.887930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:27:25.887930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:27:25.887930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:27:25.887930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:27:25.887930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiflwBMboKTbh58LY9MV46SCnkvCoDA8Lz7MKk4gwRCoxQPs10Nennf59WSFpA35k2_OuVUqc3Ildqh9KXOiYz1kwf-o_5U0rFqJBoVhvd5RC1KNKMiAiCN3X4-U5A2Z5o8ov4tv4DHgjoV-mWgbm8gyYcnkReiO1lr3jQvWIeRv7-V3g May 13 13:27:25.887930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:27:25.887930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:27:25.887930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:27:25.887930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:27:25.887930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:27:25.887930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:27:25.887930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:27:25.887930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:27:25.887930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:27:25.887930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:27:25.889579 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2c900748e271404bb3cb11fb2308e784", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}] May 13 13:27:25.889579 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:27:25.889579 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:27:25.889579 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:27:25.889579 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:27:25.889579 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:27:25.889579 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:27:25.889579 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: e25df7c837584b19afe274f6edfb8efd May 13 13:27:25.889579 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:27:25.889579 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: May 13 13:27:25.889579 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {"volumeAttachment": {"volumeId": "ce90f542-eabc-4637-b1c3-de135c942909"}} May 13 13:27:25.889579 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: > May 13 13:27:25.890402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Invalid volume: volume ce90f542-eabc-4637-b1c3-de135c942909 is already attached to instances: b86888c8-bdd2-468d-a602-67b4f27fb7af May 13 13:27:25.890402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'server_id': '14bddf7f-e172-4c36-8cb5-8752d556e11b', 'body': {'volumeAttachment': {'volumeId': 'ce90f542-eabc-4637-b1c3-de135c942909'}}} May 13 13:27:25.890402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:27:25.890402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:27:25.890402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 13 13:27:25.890402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 13 13:27:25.890402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 13:27:25.890402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 13:27:25.890402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 13 13:27:25.890402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 13 13:27:25.890402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 13 13:27:25.890402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 13 13:27:25.890402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 13 13:27:25.890402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 13 13:27:25.890402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ce90f542-eabc-4637-b1c3-de135c942909 is already attached to instances: b86888c8-bdd2-468d-a602-67b4f27fb7af May 13 13:27:25.890402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:27:25.890402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:27:25.890402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:27:25.890402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:27:25.891529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:27:25.891529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:27:25.891529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:27:25.891529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:27:25.891529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:27:25.891529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:27:25.891529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 13:27:25.891529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:27:25.891529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 13:27:25.891529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:27:25.891529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 13:27:25.891529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:27:25.891529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 13 13:27:25.891529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 13 13:27:25.891529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ce90f542-eabc-4637-b1c3-de135c942909 is already attached to instances: b86888c8-bdd2-468d-a602-67b4f27fb7af May 13 13:27:25.891529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:27:25.891529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:27:25.891529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:27:25.891529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:27:25.891529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:27:25.892742 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:27:25.892742 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:27:25.892742 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:27:25.892742 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ce90f542-eabc-4637-b1c3-de135c942909 is already attached to instances: b86888c8-bdd2-468d-a602-67b4f27fb7af May 13 13:27:25.892742 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:27:25.898638 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1a8551ca-a725-4c72-9091-f1b1389a79af tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Returning 400 to user: Invalid volume: volume ce90f542-eabc-4637-b1c3-de135c942909 is already attached to instances: b86888c8-bdd2-468d-a602-67b4f27fb7af {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:27:25.899699 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1a8551ca-a725-4c72-9091-f1b1389a79af tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "POST /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.196182 May 13 13:27:25.900299 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 276/545] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 13 13:27:25 2022] POST /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b/os-volume_attachments => generated 174 bytes in 198 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 13:27:25.908639 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ac176790-71eb-4e6f-b7d6-768193003276 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:25.909133 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ac176790-71eb-4e6f-b7d6-768193003276 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:25.933768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ac176790-71eb-4e6f-b7d6-768193003276 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:25.934241 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ac176790-71eb-4e6f-b7d6-768193003276 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:25.935197 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ac176790-71eb-4e6f-b7d6-768193003276 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:25.935637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ac176790-71eb-4e6f-b7d6-768193003276 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:25.999997 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ac176790-71eb-4e6f-b7d6-768193003276 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Going to try to terminate instance {{(pid=117720) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:27:26.024161 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-80654f3a-ee70-4f66-a4e0-25ede653b48c req-791069e3-e622-471b-b652-0c620ca238f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6", "name": "network-vif-deleted", "tag": "c523458e-8e82-46df-bfae-db11fc8b2ec5"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:26.035312 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-80654f3a-ee70-4f66-a4e0-25ede653b48c req-791069e3-e622-471b-b652-0c620ca238f3 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:26.036015 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-80654f3a-ee70-4f66-a4e0-25ede653b48c req-791069e3-e622-471b-b652-0c620ca238f3 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:26.071670 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-80654f3a-ee70-4f66-a4e0-25ede653b48c req-791069e3-e622-471b-b652-0c620ca238f3 service nova] Creating event network-vif-deleted:c523458e-8e82-46df-bfae-db11fc8b2ec5 for instance 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 on hv-cinder-84163 May 13 13:27:26.078396 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-80654f3a-ee70-4f66-a4e0-25ede653b48c req-791069e3-e622-471b-b652-0c620ca238f3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058197 May 13 13:27:26.083061 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 277/546] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:27:26.482474 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ac176790-71eb-4e6f-b7d6-768193003276 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "DELETE /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 204 len: 0 microversion: 2.1 time: 0.576638 May 13 13:27:26.484191 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 270/547] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:27:25 2022] DELETE /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 0 bytes in 580 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:27:26.496847 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-98a4a983-ba96-4d9f-81de-194b27cab660 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:26.497909 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-98a4a983-ba96-4d9f-81de-194b27cab660 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:26.528787 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-98a4a983-ba96-4d9f-81de-194b27cab660 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:26.528787 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-98a4a983-ba96-4d9f-81de-194b27cab660 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:26.528787 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-98a4a983-ba96-4d9f-81de-194b27cab660 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:26.528787 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-98a4a983-ba96-4d9f-81de-194b27cab660 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:26.543588 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-56e82ffd-08c1-4eb0-82f8-ea4bb77ddaa3 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Action: 'create', calling method: .version_select at 0x7fb084199ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1509969682", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPR+pqhiAmfnhIR1V0kdFARSkR9Ddal4OFAQDfbYb5F9geoBegwKvqOV8HHYTtENhENBN8aVOY33Bo3tFzqt0LOq3DIniXptieohKcG1qu4T3we6FbnYPNZ2TFV4Itj5Nw=="}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:26.577268 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-56e82ffd-08c1-4eb0-82f8-ea4bb77ddaa3 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Getting quotas for project 8286d953594e4d539ca45c8a98bd435c. Resources: {'key_pairs'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:27:26.586755 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-56e82ffd-08c1-4eb0-82f8-ea4bb77ddaa3 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Getting quotas for user 8e135e636ed64741a890205b367efd40 and project 8286d953594e4d539ca45c8a98bd435c. Resources: {'key_pairs'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:27:26.724697 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-56e82ffd-08c1-4eb0-82f8-ea4bb77ddaa3 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.452727 May 13 13:27:26.724697 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 278/548] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 13 13:27:26 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:27:26.731563 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0e302515-737e-4630-a8e7-fefadbbfabdb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:26.738526 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0e302515-737e-4630-a8e7-fefadbbfabdb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:26.742495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-98a4a983-ba96-4d9f-81de-194b27cab660 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:26.754905 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-98a4a983-ba96-4d9f-81de-194b27cab660 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1681 microversion: 2.1 time: 0.264791 May 13 13:27:26.767228 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 271/549] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:26 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1681 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:26.768180 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0e302515-737e-4630-a8e7-fefadbbfabdb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:26.768906 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0e302515-737e-4630-a8e7-fefadbbfabdb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:26.770021 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0e302515-737e-4630-a8e7-fefadbbfabdb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:26.770695 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0e302515-737e-4630-a8e7-fefadbbfabdb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:26.782144 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-22abe662-e443-4e8d-b44e-f61c57f1cc8f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:26.787076 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-22abe662-e443-4e8d-b44e-f61c57f1cc8f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:26.793469 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-22abe662-e443-4e8d-b44e-f61c57f1cc8f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:26.794445 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-22abe662-e443-4e8d-b44e-f61c57f1cc8f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:26.795428 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-22abe662-e443-4e8d-b44e-f61c57f1cc8f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:26.797146 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-22abe662-e443-4e8d-b44e-f61c57f1cc8f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:26.877379 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0e302515-737e-4630-a8e7-fefadbbfabdb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:26.912845 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0e302515-737e-4630-a8e7-fefadbbfabdb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:26.915979 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0e302515-737e-4630-a8e7-fefadbbfabdb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:26.918578 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0e302515-737e-4630-a8e7-fefadbbfabdb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1367 microversion: 2.20 time: 0.201903 May 13 13:27:26.923194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 279/550] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:27:26 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:27.044511 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-22abe662-e443-4e8d-b44e-f61c57f1cc8f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:27.058320 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-22abe662-e443-4e8d-b44e-f61c57f1cc8f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1723 microversion: 2.1 time: 0.286037 May 13 13:27:27.058320 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 272/551] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:26 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1723 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:27.776731 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2ed67a1d-99a4-4b26-863f-ebcdff88aa20 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:27.776731 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2ed67a1d-99a4-4b26-863f-ebcdff88aa20 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:27.784862 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2ed67a1d-99a4-4b26-863f-ebcdff88aa20 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:27.785307 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2ed67a1d-99a4-4b26-863f-ebcdff88aa20 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:27.786150 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2ed67a1d-99a4-4b26-863f-ebcdff88aa20 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:27.786775 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2ed67a1d-99a4-4b26-863f-ebcdff88aa20 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:27.940578 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-79b1e7a9-f5d5-4b92-9874-36a448a6c242 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:27.941186 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-79b1e7a9-f5d5-4b92-9874-36a448a6c242 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:27.947998 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-79b1e7a9-f5d5-4b92-9874-36a448a6c242 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:27.948432 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-79b1e7a9-f5d5-4b92-9874-36a448a6c242 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:27.949242 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-79b1e7a9-f5d5-4b92-9874-36a448a6c242 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:27.949667 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-79b1e7a9-f5d5-4b92-9874-36a448a6c242 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:27.967567 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2ed67a1d-99a4-4b26-863f-ebcdff88aa20 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:27.977982 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2ed67a1d-99a4-4b26-863f-ebcdff88aa20 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1681 microversion: 2.1 time: 0.207258 May 13 13:27:27.979381 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 280/552] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:27 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1681 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:28.007140 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-79b1e7a9-f5d5-4b92-9874-36a448a6c242 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:28.007579 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-79b1e7a9-f5d5-4b92-9874-36a448a6c242 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:28.008032 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-79b1e7a9-f5d5-4b92-9874-36a448a6c242 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lazy-loading 'fault' on Instance uuid 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:27:28.074442 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a8caaa00-f81a-4b2c-9100-437917868c4d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:28.076064 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a8caaa00-f81a-4b2c-9100-437917868c4d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:28.084671 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a8caaa00-f81a-4b2c-9100-437917868c4d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:28.086503 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a8caaa00-f81a-4b2c-9100-437917868c4d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:28.094241 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a8caaa00-f81a-4b2c-9100-437917868c4d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:28.094985 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a8caaa00-f81a-4b2c-9100-437917868c4d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:28.107001 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-79b1e7a9-f5d5-4b92-9874-36a448a6c242 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:28.121574 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-79b1e7a9-f5d5-4b92-9874-36a448a6c242 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:28.134670 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-79b1e7a9-f5d5-4b92-9874-36a448a6c242 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:28.138617 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-79b1e7a9-f5d5-4b92-9874-36a448a6c242 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 200 len: 1372 microversion: 2.20 time: 0.200642 May 13 13:27:28.152399 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 273/553] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:27:27 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 1372 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:27:28.306999 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a8caaa00-f81a-4b2c-9100-437917868c4d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:28.331781 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a8caaa00-f81a-4b2c-9100-437917868c4d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1729 microversion: 2.1 time: 0.261137 May 13 13:27:28.346682 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 281/554] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:28 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1729 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:28.350478 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ef9d8200-3c53-4b27-9485-6d424019819d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:28.351100 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ef9d8200-3c53-4b27-9485-6d424019819d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:28.361108 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ef9d8200-3c53-4b27-9485-6d424019819d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:28.362618 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ef9d8200-3c53-4b27-9485-6d424019819d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:28.366075 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ef9d8200-3c53-4b27-9485-6d424019819d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:28.366655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ef9d8200-3c53-4b27-9485-6d424019819d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:28.548287 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ef9d8200-3c53-4b27-9485-6d424019819d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.202748 May 13 13:27:28.549504 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 274/555] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 13 13:27:28 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686/os-interface => generated 284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:27:29.000129 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a03b8c25-d9ca-4764-b699-af3c7639b155 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:29.000740 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a03b8c25-d9ca-4764-b699-af3c7639b155 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:29.016225 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a03b8c25-d9ca-4764-b699-af3c7639b155 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:29.019247 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a03b8c25-d9ca-4764-b699-af3c7639b155 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:29.027218 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a03b8c25-d9ca-4764-b699-af3c7639b155 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:29.027218 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a03b8c25-d9ca-4764-b699-af3c7639b155 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:29.170732 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-01cf104e-74db-47c9-b010-500d110bcc21 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:29.170732 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-01cf104e-74db-47c9-b010-500d110bcc21 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:29.213915 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-01cf104e-74db-47c9-b010-500d110bcc21 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:29.215478 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-01cf104e-74db-47c9-b010-500d110bcc21 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:29.218942 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-01cf104e-74db-47c9-b010-500d110bcc21 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:29.219528 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-01cf104e-74db-47c9-b010-500d110bcc21 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:29.281003 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-01cf104e-74db-47c9-b010-500d110bcc21 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] HTTP exception thrown: Instance 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 could not be found. May 13 13:27:29.283495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-01cf104e-74db-47c9-b010-500d110bcc21 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Request method failure captured: May 13 13:27:29.283495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 HTTP/1.1 May 13 13:27:29.283495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept: application/json May 13 13:27:29.283495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity May 13 13:27:29.283495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Connection: close May 13 13:27:29.283495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Length: 0 May 13 13:27:29.283495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Type: application/json May 13 13:27:29.283495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Host: 10.222.0.13 May 13 13:27:29.283495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None May 13 13:27:29.283495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 May 13 13:27:29.283495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiflvCuexKDwWzS0mahnmFq7oK9PV0UsmMNMAwnsdXMncXdm0zgwqauUJ7HXKWgw7vY_9I6r-HpUMK0Dojb4Hnu8l2mseakiywyvSYX8lFqUDFhwQXlwcCFf_5QC0JneN1-i2JCHEl6ZR5oIZV7yKZdQvi0m9przSh_84p6HPp7etHHHQ May 13 13:27:29.283495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Id: None May 13 13:27:29.283495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Name: None May 13 13:27:29.283495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed May 13 13:27:29.283495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True May 13 13:27:29.283495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Openstack-Nova-Api-Version: 2.20 May 13 13:27:29.283495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default May 13 13:27:29.283495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default May 13 13:27:29.283495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Id: 99575e3d89514f96b2f6f9d871ba0792 May 13 13:27:29.283495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1322049744 May 13 13:27:29.283495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Role: member,reader May 13 13:27:29.283495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Roles: member,reader May 13 13:27:29.284914 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99575e3d89514f96b2f6f9d871ba0792", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99575e3d89514f96b2f6f9d871ba0792"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99575e3d89514f96b2f6f9d871ba0792"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99575e3d89514f96b2f6f9d871ba0792"}]}] May 13 13:27:29.284914 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1322049744 May 13 13:27:29.284914 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 99575e3d89514f96b2f6f9d871ba0792 May 13 13:27:29.284914 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1322049744 May 13 13:27:29.284914 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User: tempest-AttachVolumeShelveTestJSON-1322049744-project May 13 13:27:29.284914 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default May 13 13:27:29.284914 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default May 13 13:27:29.284914 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Id: cbbf4d7cd80146458e33ace6cbbe9594 May 13 13:27:29.284914 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1322049744-project May 13 13:27:29.284914 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: method: > May 13 13:27:29.284914 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: exception: Instance 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 could not be found. May 13 13:27:29.284914 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: action_args: {'id': '0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6'} May 13 13:27:29.285634 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:27:29.285634 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:27:29.285634 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:27:29.285634 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:27:29.285634 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:27:29.285634 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:27:29.285634 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:27:29.285634 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:27:29.285634 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:27:29.285634 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:27:29.285634 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 could not be found. May 13 13:27:29.285634 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:27:29.285634 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:27:29.285634 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:27:29.285634 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:27:29.285634 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:27:29.285634 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:27:29.285634 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:27:29.285634 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:27:29.285634 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:27:29.286872 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:27:29.286872 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:27:29.286872 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:27:29.286872 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:27:29.286872 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:27:29.286872 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:27:29.286872 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:27:29.286872 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 could not be found. May 13 13:27:29.286872 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:27:29.286872 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:27:29.286872 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:27:29.286872 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:27:29.286872 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:27:29.286872 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:27:29.286872 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:27:29.286872 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:27:29.286872 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 could not be found. May 13 13:27:29.286872 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:27:29.302983 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-01cf104e-74db-47c9-b010-500d110bcc21 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Returning 404 to user: Instance 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:27:29.307283 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-01cf104e-74db-47c9-b010-500d110bcc21 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 404 len: 111 microversion: 2.20 time: 0.150564 May 13 13:27:29.307283 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 275/556] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:27:29 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 13:27:29.321392 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b20f848a-2923-41f9-925d-182b4851ccbb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '.version_select at 0x7fb0841e9d30>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:29.400563 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a03b8c25-d9ca-4764-b699-af3c7639b155 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:29.414768 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a03b8c25-d9ca-4764-b699-af3c7639b155 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1681 microversion: 2.1 time: 0.417886 May 13 13:27:29.415965 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 282/557] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:28 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1681 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:29.438422 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b20f848a-2923-41f9-925d-182b4851ccbb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1930063895" status: 204 len: 0 microversion: 2.20 time: 0.128979 May 13 13:27:29.439110 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 276/558] 10.222.0.13 () {60 vars in 1261 bytes} [Fri May 13 13:27:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1930063895 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 13:27:30.433735 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7a6ffd4c-3f0b-41b5-b67a-280988062d56 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:30.434554 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7a6ffd4c-3f0b-41b5-b67a-280988062d56 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:30.445076 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7a6ffd4c-3f0b-41b5-b67a-280988062d56 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:30.445520 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7a6ffd4c-3f0b-41b5-b67a-280988062d56 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:30.453100 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7a6ffd4c-3f0b-41b5-b67a-280988062d56 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:30.462275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7a6ffd4c-3f0b-41b5-b67a-280988062d56 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:30.607411 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7a6ffd4c-3f0b-41b5-b67a-280988062d56 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:30.635166 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7a6ffd4c-3f0b-41b5-b67a-280988062d56 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1613 microversion: 2.1 time: 0.205763 May 13 13:27:30.641278 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 283/559] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:30 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1613 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:30.701897 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-c7445574-ef5b-4da8-9bd4-a873dab61763 req-d96c03e0-5f44-4f73-839e-81de6ba5de63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba162312-5c53-4320-acc9-4e2566f27686", "tag": "bc491e34-66dc-4f6f-9292-c68b5d9c9928"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:30.742591 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-c7445574-ef5b-4da8-9bd4-a873dab61763 req-d96c03e0-5f44-4f73-839e-81de6ba5de63 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:30.744735 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-c7445574-ef5b-4da8-9bd4-a873dab61763 req-d96c03e0-5f44-4f73-839e-81de6ba5de63 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:30.773422 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-c7445574-ef5b-4da8-9bd4-a873dab61763 req-d96c03e0-5f44-4f73-839e-81de6ba5de63 service nova] Creating event network-changed:bc491e34-66dc-4f6f-9292-c68b5d9c9928 for instance ba162312-5c53-4320-acc9-4e2566f27686 on hv-cinder-84163 May 13 13:27:30.785249 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-c7445574-ef5b-4da8-9bd4-a873dab61763 req-d96c03e0-5f44-4f73-839e-81de6ba5de63 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091318 May 13 13:27:30.792251 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 277/560] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:27:31.101233 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-3b62a534-e09f-45d5-959d-c868e1ad300b req-58b234d2-f695-4ea7-9517-54b4e13f2e06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14bddf7f-e172-4c36-8cb5-8752d556e11b", "name": "network-vif-deleted", "tag": "3545091d-ebe5-4fc8-8e1a-ed10472f81d7"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:31.115923 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-3b62a534-e09f-45d5-959d-c868e1ad300b req-58b234d2-f695-4ea7-9517-54b4e13f2e06 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:31.117362 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-3b62a534-e09f-45d5-959d-c868e1ad300b req-58b234d2-f695-4ea7-9517-54b4e13f2e06 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:31.142939 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-3b62a534-e09f-45d5-959d-c868e1ad300b req-58b234d2-f695-4ea7-9517-54b4e13f2e06 service nova] Creating event network-vif-deleted:3545091d-ebe5-4fc8-8e1a-ed10472f81d7 for instance 14bddf7f-e172-4c36-8cb5-8752d556e11b on hv-cinder-84163 May 13 13:27:31.157547 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-3b62a534-e09f-45d5-959d-c868e1ad300b req-58b234d2-f695-4ea7-9517-54b4e13f2e06 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060427 May 13 13:27:31.157547 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 284/561] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:27:31.477055 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-799ac567-83d9-4d51-aa38-69060386f6b1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Action: 'create', calling method: .version_select at 0x7fb0841e9d30>, body: {"keypair": {"name": "tempest-keypair-806290900", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaVQ4GD7WMSSFgUbaJRk/SyGM8bS4bG+6tCogqKtZH2u8QCNjfAfy3sVDJZPo/GvaPnhOUelf5ZfOqATdJiso049q42ADKZZ4VkEJWcCcVtayR4DOPyQPnpGF/33TUAPA=="}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:31.499463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-799ac567-83d9-4d51-aa38-69060386f6b1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Getting quotas for project 99575e3d89514f96b2f6f9d871ba0792. Resources: {'key_pairs'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:27:31.505178 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-799ac567-83d9-4d51-aa38-69060386f6b1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Getting quotas for user cbbf4d7cd80146458e33ace6cbbe9594 and project 99575e3d89514f96b2f6f9d871ba0792. Resources: {'key_pairs'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:27:31.629279 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-799ac567-83d9-4d51-aa38-69060386f6b1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.155063 May 13 13:27:31.631164 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 278/562] 10.222.0.13 () {62 vars in 1199 bytes} [Fri May 13 13:27:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 159 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 13 13:27:31.660016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c82a2065-e0ad-4aab-9e23-63159ac251a3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:31.660778 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c82a2065-e0ad-4aab-9e23-63159ac251a3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:31.671822 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c82a2065-e0ad-4aab-9e23-63159ac251a3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:31.672349 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c82a2065-e0ad-4aab-9e23-63159ac251a3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:31.673250 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c82a2065-e0ad-4aab-9e23-63159ac251a3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:31.673822 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c82a2065-e0ad-4aab-9e23-63159ac251a3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:31.733284 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c82a2065-e0ad-4aab-9e23-63159ac251a3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:31.734919 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c82a2065-e0ad-4aab-9e23-63159ac251a3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:31.735390 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-c82a2065-e0ad-4aab-9e23-63159ac251a3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lazy-loading 'fault' on Instance uuid 14bddf7f-e172-4c36-8cb5-8752d556e11b {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:27:31.788629 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c82a2065-e0ad-4aab-9e23-63159ac251a3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:31.800143 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c82a2065-e0ad-4aab-9e23-63159ac251a3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 200 len: 1332 microversion: 2.1 time: 0.146225 May 13 13:27:31.801081 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 285/563] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:31 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 1332 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:32.814472 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-2e53ed7b-015a-4313-9696-9c6c14418537 req-dc198dd0-497e-44e4-aa23-2c62bc16b2b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba162312-5c53-4320-acc9-4e2566f27686", "tag": "bc491e34-66dc-4f6f-9292-c68b5d9c9928"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:32.820818 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0eeaf37a-5c18-40d6-b426-be3190a13994 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:32.821723 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0eeaf37a-5c18-40d6-b426-be3190a13994 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:32.830581 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0eeaf37a-5c18-40d6-b426-be3190a13994 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:32.831144 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0eeaf37a-5c18-40d6-b426-be3190a13994 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:32.832047 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0eeaf37a-5c18-40d6-b426-be3190a13994 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:32.832569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0eeaf37a-5c18-40d6-b426-be3190a13994 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:32.848189 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-2e53ed7b-015a-4313-9696-9c6c14418537 req-dc198dd0-497e-44e4-aa23-2c62bc16b2b5 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:32.849403 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-2e53ed7b-015a-4313-9696-9c6c14418537 req-dc198dd0-497e-44e4-aa23-2c62bc16b2b5 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:32.850414 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-0eeaf37a-5c18-40d6-b426-be3190a13994 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] HTTP exception thrown: Instance 14bddf7f-e172-4c36-8cb5-8752d556e11b could not be found. May 13 13:27:32.852262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0eeaf37a-5c18-40d6-b426-be3190a13994 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Request method failure captured: May 13 13:27:32.852262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b HTTP/1.1 May 13 13:27:32.852262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:27:32.852262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:27:32.852262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:27:32.852262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:27:32.852262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:27:32.852262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:27:32.852262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:27:32.852262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:27:32.852262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiflwBMboKTbh58LY9MV46SCnkvCoDA8Lz7MKk4gwRCoxQPs10Nennf59WSFpA35k2_OuVUqc3Ildqh9KXOiYz1kwf-o_5U0rFqJBoVhvd5RC1KNKMiAiCN3X4-U5A2Z5o8ov4tv4DHgjoV-mWgbm8gyYcnkReiO1lr3jQvWIeRv7-V3g May 13 13:27:32.852262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:27:32.852262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:27:32.852262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:27:32.852262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:27:32.852262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:27:32.852262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:27:32.852262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:27:32.852262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:27:32.852262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:27:32.852262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:27:32.853615 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2c900748e271404bb3cb11fb2308e784", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}] May 13 13:27:32.853615 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:27:32.853615 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:27:32.853615 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:27:32.853615 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:27:32.853615 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:27:32.853615 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:27:32.853615 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: e25df7c837584b19afe274f6edfb8efd May 13 13:27:32.853615 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:27:32.853615 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: > May 13 13:27:32.853615 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Instance 14bddf7f-e172-4c36-8cb5-8752d556e11b could not be found. May 13 13:27:32.853615 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': '14bddf7f-e172-4c36-8cb5-8752d556e11b'} May 13 13:27:32.855029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:27:32.855029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:27:32.855029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:27:32.855029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:27:32.855029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:27:32.855029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:27:32.855029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:27:32.855029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:27:32.855029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:27:32.855029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:27:32.855029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14bddf7f-e172-4c36-8cb5-8752d556e11b could not be found. May 13 13:27:32.855029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:27:32.855029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:27:32.855029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:27:32.855029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:27:32.855029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:27:32.855029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:27:32.855029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:27:32.855029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:27:32.855029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:27:32.858020 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:27:32.858020 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:27:32.858020 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:27:32.858020 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:27:32.858020 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:27:32.858020 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:27:32.858020 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:27:32.858020 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14bddf7f-e172-4c36-8cb5-8752d556e11b could not be found. May 13 13:27:32.858020 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:27:32.858020 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:27:32.858020 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:27:32.858020 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:27:32.858020 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:27:32.858020 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:27:32.858020 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:27:32.858020 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:27:32.858020 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14bddf7f-e172-4c36-8cb5-8752d556e11b could not be found. May 13 13:27:32.858020 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:27:32.863144 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0eeaf37a-5c18-40d6-b426-be3190a13994 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Returning 404 to user: Instance 14bddf7f-e172-4c36-8cb5-8752d556e11b could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:27:32.863144 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0eeaf37a-5c18-40d6-b426-be3190a13994 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 404 len: 111 microversion: 2.1 time: 0.037252 May 13 13:27:32.863144 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 286/564] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:32 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 13:27:32.866497 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-2e53ed7b-015a-4313-9696-9c6c14418537 req-dc198dd0-497e-44e4-aa23-2c62bc16b2b5 service nova] Creating event network-changed:bc491e34-66dc-4f6f-9292-c68b5d9c9928 for instance ba162312-5c53-4320-acc9-4e2566f27686 on hv-cinder-84163 May 13 13:27:32.869365 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ef376684-9217-4c80-82e0-6691a239226b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '.version_select at 0x7fb084199940>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:32.871595 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-2e53ed7b-015a-4313-9696-9c6c14418537 req-dc198dd0-497e-44e4-aa23-2c62bc16b2b5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072196 May 13 13:27:32.872705 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 279/565] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:27:33.040598 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ef376684-9217-4c80-82e0-6691a239226b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1147882846" status: 202 len: 0 microversion: 2.1 time: 0.175294 May 13 13:27:33.041296 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 287/566] 10.222.0.13 () {58 vars in 1220 bytes} [Fri May 13 13:27:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1147882846 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:27:34.241851 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7ebb4dae-cc09-401a-9da0-25afd8b5b95a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:34.242449 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7ebb4dae-cc09-401a-9da0-25afd8b5b95a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:34.249403 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7ebb4dae-cc09-401a-9da0-25afd8b5b95a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:34.249845 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7ebb4dae-cc09-401a-9da0-25afd8b5b95a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:34.250642 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7ebb4dae-cc09-401a-9da0-25afd8b5b95a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:34.251073 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7ebb4dae-cc09-401a-9da0-25afd8b5b95a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:34.345847 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-7ebb4dae-cc09-401a-9da0-25afd8b5b95a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lazy-loading 'services' on Instance uuid b86888c8-bdd2-468d-a602-67b4f27fb7af {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:27:34.593164 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7ebb4dae-cc09-401a-9da0-25afd8b5b95a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af/os-volume_attachments/ce90f542-eabc-4637-b1c3-de135c942909" status: 202 len: 0 microversion: 2.1 time: 0.355866 May 13 13:27:34.594209 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 280/567] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 13 13:27:34 2022] DELETE /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af/os-volume_attachments/ce90f542-eabc-4637-b1c3-de135c942909 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:27:34.605172 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5734bc7c-bd28-40e1-8299-2e863fd1bb46 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:34.608429 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5734bc7c-bd28-40e1-8299-2e863fd1bb46 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:34.615467 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5734bc7c-bd28-40e1-8299-2e863fd1bb46 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:34.615910 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5734bc7c-bd28-40e1-8299-2e863fd1bb46 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:34.616842 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5734bc7c-bd28-40e1-8299-2e863fd1bb46 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:34.617333 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5734bc7c-bd28-40e1-8299-2e863fd1bb46 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:34.651488 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5734bc7c-bd28-40e1-8299-2e863fd1bb46 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051542 May 13 13:27:34.652063 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 288/568] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 13 13:27:34 2022] GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:27:35.020600 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-173cc1ee-d26b-415e-a8f2-a88c41dc5fde tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1168654438", "imageRef": "ece294e8-5415-4d6a-a0d3-a14539c51c0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a7e06528-db27-472b-858f-4ca58111325e"}], "security_groups": [{"name": "tempest-securitygroup--1736028673"}], "key_name": "tempest-keypair-806290900", "user_data": "}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:35.132738 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.network.neutron [None req-173cc1ee-d26b-415e-a8f2-a88c41dc5fde tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] validate_networks() for [('a7e06528-db27-472b-858f-4ca58111325e', None, None, None, None, None)] {{(pid=117720) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:27:35.553946 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-173cc1ee-d26b-415e-a8f2-a88c41dc5fde tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Flavor limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:27:35.554641 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-173cc1ee-d26b-415e-a8f2-a88c41dc5fde tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Image limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:27:35.555119 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-173cc1ee-d26b-415e-a8f2-a88c41dc5fde tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Flavor pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:27:35.555522 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-173cc1ee-d26b-415e-a8f2-a88c41dc5fde tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Image pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:27:35.555927 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-173cc1ee-d26b-415e-a8f2-a88c41dc5fde tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:27:35.565196 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-173cc1ee-d26b-415e-a8f2-a88c41dc5fde tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:35.565639 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-173cc1ee-d26b-415e-a8f2-a88c41dc5fde tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:35.566474 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-173cc1ee-d26b-415e-a8f2-a88c41dc5fde tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:35.566913 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-173cc1ee-d26b-415e-a8f2-a88c41dc5fde tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:35.586276 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-173cc1ee-d26b-415e-a8f2-a88c41dc5fde tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Getting quotas for project 99575e3d89514f96b2f6f9d871ba0792. Resources: {'cores', 'instances', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:27:35.591854 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-173cc1ee-d26b-415e-a8f2-a88c41dc5fde tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Getting quotas for user cbbf4d7cd80146458e33ace6cbbe9594 and project 99575e3d89514f96b2f6f9d871ba0792. Resources: {'cores', 'instances', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:27:35.603057 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-173cc1ee-d26b-415e-a8f2-a88c41dc5fde tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Going to run 1 instances... {{(pid=117720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:27:35.605410 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-173cc1ee-d26b-415e-a8f2-a88c41dc5fde tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ece294e8-5415-4d6a-a0d3-a14539c51c0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:27:35.663067 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-89563c8b-d603-4d41-af25-3593190faffa tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:35.663993 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-89563c8b-d603-4d41-af25-3593190faffa tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:35.671244 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-89563c8b-d603-4d41-af25-3593190faffa tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:35.671706 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-89563c8b-d603-4d41-af25-3593190faffa tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:35.672504 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-89563c8b-d603-4d41-af25-3593190faffa tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:35.672965 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-89563c8b-d603-4d41-af25-3593190faffa tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:35.711554 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-89563c8b-d603-4d41-af25-3593190faffa tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048940 May 13 13:27:35.711554 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 289/569] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 13 13:27:35 2022] GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:27:35.779917 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-173cc1ee-d26b-415e-a8f2-a88c41dc5fde tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.763923 May 13 13:27:35.780569 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 281/570] 10.222.0.13 () {62 vars in 1187 bytes} [Fri May 13 13:27:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 13 13:27:35.790966 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ed88cca2-ef50-4253-8147-523b391cf457 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:35.791587 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ed88cca2-ef50-4253-8147-523b391cf457 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:35.859595 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ed88cca2-ef50-4253-8147-523b391cf457 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:35.866971 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ed88cca2-ef50-4253-8147-523b391cf457 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:35.868476 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ed88cca2-ef50-4253-8147-523b391cf457 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:35.869561 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ed88cca2-ef50-4253-8147-523b391cf457 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1281 microversion: 2.20 time: 0.082725 May 13 13:27:35.870241 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 290/571] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:27:35 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1281 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:36.722505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b6123c03-8eff-4bf2-86c2-8f139d9afdc3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:36.723480 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b6123c03-8eff-4bf2-86c2-8f139d9afdc3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:36.730529 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b6123c03-8eff-4bf2-86c2-8f139d9afdc3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:36.730971 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b6123c03-8eff-4bf2-86c2-8f139d9afdc3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:36.732460 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b6123c03-8eff-4bf2-86c2-8f139d9afdc3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:36.733032 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b6123c03-8eff-4bf2-86c2-8f139d9afdc3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:36.764247 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b6123c03-8eff-4bf2-86c2-8f139d9afdc3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046936 May 13 13:27:36.764829 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 282/572] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 13 13:27:36 2022] GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 13:27:36.840056 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8398c97a-051c-4b8b-be94-8898bb25dcf5 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:36.840651 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8398c97a-051c-4b8b-be94-8898bb25dcf5 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:36.849143 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8398c97a-051c-4b8b-be94-8898bb25dcf5 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:36.849593 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8398c97a-051c-4b8b-be94-8898bb25dcf5 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:36.850395 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8398c97a-051c-4b8b-be94-8898bb25dcf5 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:36.850826 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8398c97a-051c-4b8b-be94-8898bb25dcf5 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:36.880812 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8398c97a-051c-4b8b-be94-8898bb25dcf5 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Going to try to terminate instance {{(pid=117721) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:27:36.891919 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1c763005-7af0-43bb-a25f-c4ea9f660d8b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:36.892545 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1c763005-7af0-43bb-a25f-c4ea9f660d8b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:36.898979 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1c763005-7af0-43bb-a25f-c4ea9f660d8b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:36.899426 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1c763005-7af0-43bb-a25f-c4ea9f660d8b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:36.900402 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1c763005-7af0-43bb-a25f-c4ea9f660d8b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:36.900840 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1c763005-7af0-43bb-a25f-c4ea9f660d8b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:36.973159 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1c763005-7af0-43bb-a25f-c4ea9f660d8b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:36.984914 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1c763005-7af0-43bb-a25f-c4ea9f660d8b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:36.986498 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1c763005-7af0-43bb-a25f-c4ea9f660d8b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:36.987638 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1c763005-7af0-43bb-a25f-c4ea9f660d8b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1285 microversion: 2.20 time: 0.102739 May 13 13:27:36.988198 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 283/573] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:27:36 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:37.255701 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8398c97a-051c-4b8b-be94-8898bb25dcf5 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af" status: 204 len: 0 microversion: 2.1 time: 0.419909 May 13 13:27:37.260142 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 291/574] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:27:36 2022] DELETE /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:27:37.265466 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-59487755-a4a8-4f79-8675-55c8d402772b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:37.266236 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-59487755-a4a8-4f79-8675-55c8d402772b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:37.277660 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-59487755-a4a8-4f79-8675-55c8d402772b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:37.278339 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-59487755-a4a8-4f79-8675-55c8d402772b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:37.279307 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-59487755-a4a8-4f79-8675-55c8d402772b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:37.279772 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-59487755-a4a8-4f79-8675-55c8d402772b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:37.420299 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-59487755-a4a8-4f79-8675-55c8d402772b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:37.427875 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-59487755-a4a8-4f79-8675-55c8d402772b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af" status: 200 len: 1681 microversion: 2.1 time: 0.166861 May 13 13:27:37.428447 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 284/575] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:37 2022] GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:38.006729 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-eeea7393-c04d-4588-8f02-eb33fb9c8245 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:38.007429 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-eeea7393-c04d-4588-8f02-eb33fb9c8245 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:38.014470 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eeea7393-c04d-4588-8f02-eb33fb9c8245 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:38.014919 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eeea7393-c04d-4588-8f02-eb33fb9c8245 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:38.015690 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eeea7393-c04d-4588-8f02-eb33fb9c8245 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:38.016121 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eeea7393-c04d-4588-8f02-eb33fb9c8245 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:38.082084 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-eeea7393-c04d-4588-8f02-eb33fb9c8245 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:38.090064 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-eeea7393-c04d-4588-8f02-eb33fb9c8245 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:38.092440 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-eeea7393-c04d-4588-8f02-eb33fb9c8245 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:38.093593 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-eeea7393-c04d-4588-8f02-eb33fb9c8245 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1277 microversion: 2.20 time: 0.091436 May 13 13:27:38.094154 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 292/576] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:27:38 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:38.445931 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a11cf60e-174f-4299-a1ce-6e9df3a8afdc tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:38.446598 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a11cf60e-174f-4299-a1ce-6e9df3a8afdc tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:38.453652 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a11cf60e-174f-4299-a1ce-6e9df3a8afdc tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:38.454101 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a11cf60e-174f-4299-a1ce-6e9df3a8afdc tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:38.454899 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a11cf60e-174f-4299-a1ce-6e9df3a8afdc tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:38.455331 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a11cf60e-174f-4299-a1ce-6e9df3a8afdc tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:38.593809 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a11cf60e-174f-4299-a1ce-6e9df3a8afdc tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:38.601837 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a11cf60e-174f-4299-a1ce-6e9df3a8afdc tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af" status: 200 len: 1681 microversion: 2.1 time: 0.159588 May 13 13:27:38.602449 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 285/577] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:38 2022] GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:39.112747 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-76c8f2f1-9889-4955-a7a9-0c95306df67d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:39.115681 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-76c8f2f1-9889-4955-a7a9-0c95306df67d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:39.123812 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-76c8f2f1-9889-4955-a7a9-0c95306df67d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:39.124260 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-76c8f2f1-9889-4955-a7a9-0c95306df67d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:39.125042 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-76c8f2f1-9889-4955-a7a9-0c95306df67d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:39.125465 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-76c8f2f1-9889-4955-a7a9-0c95306df67d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:39.194483 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-76c8f2f1-9889-4955-a7a9-0c95306df67d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:39.204060 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-76c8f2f1-9889-4955-a7a9-0c95306df67d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:39.205915 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-76c8f2f1-9889-4955-a7a9-0c95306df67d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:39.207360 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-76c8f2f1-9889-4955-a7a9-0c95306df67d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1333 microversion: 2.20 time: 0.098832 May 13 13:27:39.207991 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 293/578] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:27:39 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1333 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:39.619540 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a1e2f9ea-3911-4f80-bb03-e6e1a4f64bf4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:39.620226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a1e2f9ea-3911-4f80-bb03-e6e1a4f64bf4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:39.627208 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a1e2f9ea-3911-4f80-bb03-e6e1a4f64bf4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:39.627655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a1e2f9ea-3911-4f80-bb03-e6e1a4f64bf4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:39.628425 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a1e2f9ea-3911-4f80-bb03-e6e1a4f64bf4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:39.628865 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a1e2f9ea-3911-4f80-bb03-e6e1a4f64bf4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:39.802355 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a1e2f9ea-3911-4f80-bb03-e6e1a4f64bf4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:39.809868 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a1e2f9ea-3911-4f80-bb03-e6e1a4f64bf4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af" status: 200 len: 1681 microversion: 2.1 time: 0.194277 May 13 13:27:39.810601 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 286/579] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:39 2022] GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af => generated 1681 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:40.226121 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-812d0331-71f1-408f-be6f-cf324d6ec65c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:40.234369 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-812d0331-71f1-408f-be6f-cf324d6ec65c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:40.242166 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-812d0331-71f1-408f-be6f-cf324d6ec65c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:40.242913 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-812d0331-71f1-408f-be6f-cf324d6ec65c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:40.243929 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-812d0331-71f1-408f-be6f-cf324d6ec65c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:40.244737 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-812d0331-71f1-408f-be6f-cf324d6ec65c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:40.334016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-812d0331-71f1-408f-be6f-cf324d6ec65c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:40.349351 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-812d0331-71f1-408f-be6f-cf324d6ec65c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:40.351613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-812d0331-71f1-408f-be6f-cf324d6ec65c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:40.357506 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-812d0331-71f1-408f-be6f-cf324d6ec65c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1339 microversion: 2.20 time: 0.130758 May 13 13:27:40.364560 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 294/580] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:27:40 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1339 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:40.449961 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-f6dfb857-0cd2-40a6-bd95-51f241e946b3 req-021b6002-0a07-4a6c-bf15-5aa3f2a4c928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86888c8-bdd2-468d-a602-67b4f27fb7af", "name": "network-vif-deleted", "tag": "5f9e6c55-7597-460f-acea-9d4b111093cb"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:40.462140 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-f6dfb857-0cd2-40a6-bd95-51f241e946b3 req-021b6002-0a07-4a6c-bf15-5aa3f2a4c928 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:40.465188 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-f6dfb857-0cd2-40a6-bd95-51f241e946b3 req-021b6002-0a07-4a6c-bf15-5aa3f2a4c928 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:40.491125 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-f6dfb857-0cd2-40a6-bd95-51f241e946b3 req-021b6002-0a07-4a6c-bf15-5aa3f2a4c928 service nova] Creating event network-vif-deleted:5f9e6c55-7597-460f-acea-9d4b111093cb for instance b86888c8-bdd2-468d-a602-67b4f27fb7af on hv-cinder-84163 May 13 13:27:40.496442 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-f6dfb857-0cd2-40a6-bd95-51f241e946b3 req-021b6002-0a07-4a6c-bf15-5aa3f2a4c928 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053893 May 13 13:27:40.497143 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 287/581] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:27:40.830143 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-af856f20-8765-48c4-8125-90b1ec858a7a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:40.830825 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-af856f20-8765-48c4-8125-90b1ec858a7a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:40.837169 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af856f20-8765-48c4-8125-90b1ec858a7a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:40.838224 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af856f20-8765-48c4-8125-90b1ec858a7a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:40.838439 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af856f20-8765-48c4-8125-90b1ec858a7a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:40.839110 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af856f20-8765-48c4-8125-90b1ec858a7a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:40.967124 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-af856f20-8765-48c4-8125-90b1ec858a7a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:40.975033 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-af856f20-8765-48c4-8125-90b1ec858a7a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af" status: 200 len: 1327 microversion: 2.1 time: 0.149463 May 13 13:27:40.976120 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 295/582] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:40 2022] GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af => generated 1327 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:41.374381 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ab3fa40d-53dc-4d61-9c0b-8e8ebd7d3a10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:41.375817 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ab3fa40d-53dc-4d61-9c0b-8e8ebd7d3a10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:41.382614 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ab3fa40d-53dc-4d61-9c0b-8e8ebd7d3a10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:41.383164 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ab3fa40d-53dc-4d61-9c0b-8e8ebd7d3a10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:41.383998 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ab3fa40d-53dc-4d61-9c0b-8e8ebd7d3a10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:41.384554 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ab3fa40d-53dc-4d61-9c0b-8e8ebd7d3a10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:41.533479 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ab3fa40d-53dc-4d61-9c0b-8e8ebd7d3a10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:41.558885 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ab3fa40d-53dc-4d61-9c0b-8e8ebd7d3a10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:41.561515 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ab3fa40d-53dc-4d61-9c0b-8e8ebd7d3a10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:41.562970 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ab3fa40d-53dc-4d61-9c0b-8e8ebd7d3a10 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1407 microversion: 2.20 time: 0.194643 May 13 13:27:41.575289 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 288/583] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:27:41 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:41.992699 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cc0eea63-94a9-421e-85aa-af32b34703ab tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:41.993470 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-cc0eea63-94a9-421e-85aa-af32b34703ab tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:42.000978 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cc0eea63-94a9-421e-85aa-af32b34703ab tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:42.001832 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cc0eea63-94a9-421e-85aa-af32b34703ab tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:42.003076 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cc0eea63-94a9-421e-85aa-af32b34703ab tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:42.003615 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cc0eea63-94a9-421e-85aa-af32b34703ab tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:42.020052 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-cc0eea63-94a9-421e-85aa-af32b34703ab tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] HTTP exception thrown: Instance b86888c8-bdd2-468d-a602-67b4f27fb7af could not be found. May 13 13:27:42.021726 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cc0eea63-94a9-421e-85aa-af32b34703ab tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Request method failure captured: May 13 13:27:42.021726 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af HTTP/1.1 May 13 13:27:42.021726 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:27:42.021726 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:27:42.021726 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:27:42.021726 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:27:42.021726 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:27:42.021726 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:27:42.021726 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:27:42.021726 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:27:42.021726 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiflwBMboKTbh58LY9MV46SCnkvCoDA8Lz7MKk4gwRCoxQPs10Nennf59WSFpA35k2_OuVUqc3Ildqh9KXOiYz1kwf-o_5U0rFqJBoVhvd5RC1KNKMiAiCN3X4-U5A2Z5o8ov4tv4DHgjoV-mWgbm8gyYcnkReiO1lr3jQvWIeRv7-V3g May 13 13:27:42.021726 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:27:42.021726 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:27:42.021726 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:27:42.021726 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:27:42.021726 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:27:42.021726 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:27:42.021726 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:27:42.021726 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:27:42.021726 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:27:42.021726 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:27:42.023322 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2c900748e271404bb3cb11fb2308e784", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}] May 13 13:27:42.023322 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:27:42.023322 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:27:42.023322 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:27:42.023322 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:27:42.023322 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:27:42.023322 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:27:42.023322 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: e25df7c837584b19afe274f6edfb8efd May 13 13:27:42.023322 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:27:42.023322 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: > May 13 13:27:42.023322 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Instance b86888c8-bdd2-468d-a602-67b4f27fb7af could not be found. May 13 13:27:42.023322 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': 'b86888c8-bdd2-468d-a602-67b4f27fb7af'} May 13 13:27:42.024161 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:27:42.024161 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:27:42.024161 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:27:42.024161 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:27:42.024161 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:27:42.024161 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:27:42.024161 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:27:42.024161 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:27:42.024161 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:27:42.024161 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:27:42.024161 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b86888c8-bdd2-468d-a602-67b4f27fb7af could not be found. May 13 13:27:42.024161 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:27:42.024161 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:27:42.024161 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:27:42.024161 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:27:42.024161 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:27:42.024161 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:27:42.024161 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:27:42.024161 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:27:42.024161 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:27:42.025577 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:27:42.025577 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:27:42.025577 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:27:42.025577 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:27:42.025577 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:27:42.025577 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:27:42.025577 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:27:42.025577 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b86888c8-bdd2-468d-a602-67b4f27fb7af could not be found. May 13 13:27:42.025577 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:27:42.025577 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:27:42.025577 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:27:42.025577 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:27:42.025577 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:27:42.025577 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:27:42.025577 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:27:42.025577 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:27:42.025577 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b86888c8-bdd2-468d-a602-67b4f27fb7af could not be found. May 13 13:27:42.025577 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:27:42.026883 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cc0eea63-94a9-421e-85aa-af32b34703ab tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Returning 404 to user: Instance b86888c8-bdd2-468d-a602-67b4f27fb7af could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:27:42.026883 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-cc0eea63-94a9-421e-85aa-af32b34703ab tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af" status: 404 len: 111 microversion: 2.1 time: 0.034410 May 13 13:27:42.033201 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-34d6d0eb-5d17-4e99-beed-b85522e0a35f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '.version_select at 0x7fb08421f700>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:42.036282 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 296/584] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:41 2022] GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:27:42.171141 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-34d6d0eb-5d17-4e99-beed-b85522e0a35f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1161005691" status: 202 len: 0 microversion: 2.1 time: 0.142659 May 13 13:27:42.171656 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 289/585] 10.222.0.13 () {58 vars in 1220 bytes} [Fri May 13 13:27:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1161005691 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:27:42.273899 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b3aaca2e-ef76-428f-b9ed-6429ba02791a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:42.275812 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b3aaca2e-ef76-428f-b9ed-6429ba02791a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:42.284698 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b3aaca2e-ef76-428f-b9ed-6429ba02791a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:42.285149 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b3aaca2e-ef76-428f-b9ed-6429ba02791a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:42.286691 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b3aaca2e-ef76-428f-b9ed-6429ba02791a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:42.287164 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b3aaca2e-ef76-428f-b9ed-6429ba02791a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:42.324103 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b3aaca2e-ef76-428f-b9ed-6429ba02791a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054092 May 13 13:27:42.325726 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 297/586] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 13 13:27:42 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 13:27:42.400105 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-bdb0e251-557c-4bd1-af21-9bc501c764bd tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:42.400606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-bdb0e251-557c-4bd1-af21-9bc501c764bd tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:42.408699 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bdb0e251-557c-4bd1-af21-9bc501c764bd tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:42.409417 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bdb0e251-557c-4bd1-af21-9bc501c764bd tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:42.410411 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bdb0e251-557c-4bd1-af21-9bc501c764bd tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:42.411027 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bdb0e251-557c-4bd1-af21-9bc501c764bd tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:42.451681 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-bdb0e251-557c-4bd1-af21-9bc501c764bd tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Going to try to terminate instance {{(pid=117720) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:27:42.530586 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-aeb89b7e-b5a8-40ea-af29-864e9bab2827 req-0be9f1c7-bd64-4182-ab5d-1f8190e6b5a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "274c20ca-135a-48d9-85e5-7c99cf77f68d", "tag": "729dc6f6-46b1-4dac-a320-fa9e54753c1c"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:42.542918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-aeb89b7e-b5a8-40ea-af29-864e9bab2827 req-0be9f1c7-bd64-4182-ab5d-1f8190e6b5a9 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:42.543365 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-aeb89b7e-b5a8-40ea-af29-864e9bab2827 req-0be9f1c7-bd64-4182-ab5d-1f8190e6b5a9 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:42.555592 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-aeb89b7e-b5a8-40ea-af29-864e9bab2827 req-0be9f1c7-bd64-4182-ab5d-1f8190e6b5a9 service nova] Creating event network-changed:729dc6f6-46b1-4dac-a320-fa9e54753c1c for instance 274c20ca-135a-48d9-85e5-7c99cf77f68d on hv-cinder-84163 May 13 13:27:42.562053 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-aeb89b7e-b5a8-40ea-af29-864e9bab2827 req-0be9f1c7-bd64-4182-ab5d-1f8190e6b5a9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036231 May 13 13:27:42.562745 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 298/587] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:27:42.584537 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c896cde1-f01a-4e73-b8e1-52696f41bdeb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:42.585258 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c896cde1-f01a-4e73-b8e1-52696f41bdeb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:42.592475 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c896cde1-f01a-4e73-b8e1-52696f41bdeb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:42.592923 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c896cde1-f01a-4e73-b8e1-52696f41bdeb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:42.593868 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c896cde1-f01a-4e73-b8e1-52696f41bdeb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:42.594504 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c896cde1-f01a-4e73-b8e1-52696f41bdeb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:42.751214 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c896cde1-f01a-4e73-b8e1-52696f41bdeb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:42.761184 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c896cde1-f01a-4e73-b8e1-52696f41bdeb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:42.763512 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c896cde1-f01a-4e73-b8e1-52696f41bdeb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:42.765217 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c896cde1-f01a-4e73-b8e1-52696f41bdeb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1407 microversion: 2.20 time: 0.185087 May 13 13:27:42.771820 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 299/588] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:27:42 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:42.875873 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-bdb0e251-557c-4bd1-af21-9bc501c764bd tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 204 len: 0 microversion: 2.1 time: 0.479848 May 13 13:27:42.876569 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 290/589] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:27:42 2022] DELETE /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:27:42.885045 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-9772acbe-d221-41cf-8051-6b1d2688cf4d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:42.885886 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-9772acbe-d221-41cf-8051-6b1d2688cf4d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:42.893733 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9772acbe-d221-41cf-8051-6b1d2688cf4d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:42.899361 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9772acbe-d221-41cf-8051-6b1d2688cf4d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:42.899361 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9772acbe-d221-41cf-8051-6b1d2688cf4d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:42.899361 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9772acbe-d221-41cf-8051-6b1d2688cf4d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:43.038071 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-9772acbe-d221-41cf-8051-6b1d2688cf4d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:43.046535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-9772acbe-d221-41cf-8051-6b1d2688cf4d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1672 microversion: 2.1 time: 0.165471 May 13 13:27:43.047288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 300/590] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:42 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:43.516177 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-50111c56-8026-4418-83e3-67e58fb97585 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Action: 'create', calling method: .version_select at 0x7fb0842fbdc0>, body: {"keypair": {"name": "tempest-keypair-1998875009", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCw2WafytulyQGwxiODU/lFj2sIun/Qh+QOyd1hckGtIj3F9EyApzPpxUwXNYDfD+JWspPocCyjLN8MnS7+R3neYVyUn9h7/6tbbA0Mo1w1MtldLi9pXohGxcTxBnZrYMQ=="}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:43.530876 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-50111c56-8026-4418-83e3-67e58fb97585 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Getting quotas for project 2c900748e271404bb3cb11fb2308e784. Resources: {'key_pairs'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:27:43.534966 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-50111c56-8026-4418-83e3-67e58fb97585 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Getting quotas for user e25df7c837584b19afe274f6edfb8efd and project 2c900748e271404bb3cb11fb2308e784. Resources: {'key_pairs'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:27:43.608936 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-50111c56-8026-4418-83e3-67e58fb97585 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.097178 May 13 13:27:43.609577 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 291/591] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 13 13:27:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:27:43.785891 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ce9d622c-52f8-4098-9c2c-58823b87108b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:43.786526 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ce9d622c-52f8-4098-9c2c-58823b87108b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:43.792523 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ce9d622c-52f8-4098-9c2c-58823b87108b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:43.792969 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ce9d622c-52f8-4098-9c2c-58823b87108b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:43.793763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ce9d622c-52f8-4098-9c2c-58823b87108b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:43.794226 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ce9d622c-52f8-4098-9c2c-58823b87108b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:43.936931 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ce9d622c-52f8-4098-9c2c-58823b87108b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:43.945189 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ce9d622c-52f8-4098-9c2c-58823b87108b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:43.946707 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ce9d622c-52f8-4098-9c2c-58823b87108b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:43.947798 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ce9d622c-52f8-4098-9c2c-58823b87108b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1407 microversion: 2.20 time: 0.167526 May 13 13:27:43.948350 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 301/592] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:27:43 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:44.064897 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-85906eb5-40a8-4dc7-86fe-0cd7843cb6e3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:44.065626 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-85906eb5-40a8-4dc7-86fe-0cd7843cb6e3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:44.072524 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-85906eb5-40a8-4dc7-86fe-0cd7843cb6e3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:44.072980 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-85906eb5-40a8-4dc7-86fe-0cd7843cb6e3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:44.073751 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-85906eb5-40a8-4dc7-86fe-0cd7843cb6e3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:44.074183 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-85906eb5-40a8-4dc7-86fe-0cd7843cb6e3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:44.213183 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-85906eb5-40a8-4dc7-86fe-0cd7843cb6e3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:44.228004 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-85906eb5-40a8-4dc7-86fe-0cd7843cb6e3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1672 microversion: 2.1 time: 0.167201 May 13 13:27:44.228608 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 292/593] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:44 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:44.967868 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1d70fdb5-6053-445b-900b-e0a5c47c3079 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:44.968401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1d70fdb5-6053-445b-900b-e0a5c47c3079 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:44.975254 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1d70fdb5-6053-445b-900b-e0a5c47c3079 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:44.975697 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1d70fdb5-6053-445b-900b-e0a5c47c3079 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:44.976564 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1d70fdb5-6053-445b-900b-e0a5c47c3079 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:44.977027 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1d70fdb5-6053-445b-900b-e0a5c47c3079 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:45.204547 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1d70fdb5-6053-445b-900b-e0a5c47c3079 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:45.215191 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1d70fdb5-6053-445b-900b-e0a5c47c3079 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:45.216844 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1d70fdb5-6053-445b-900b-e0a5c47c3079 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:45.218013 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1d70fdb5-6053-445b-900b-e0a5c47c3079 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1407 microversion: 2.20 time: 0.255756 May 13 13:27:45.218586 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 302/594] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:27:44 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:45.252242 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2685a0e3-463a-4297-8d87-dc33237a6cad tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:45.252834 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2685a0e3-463a-4297-8d87-dc33237a6cad tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:45.259103 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2685a0e3-463a-4297-8d87-dc33237a6cad tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:45.259550 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2685a0e3-463a-4297-8d87-dc33237a6cad tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:45.260312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2685a0e3-463a-4297-8d87-dc33237a6cad tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:45.260740 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2685a0e3-463a-4297-8d87-dc33237a6cad tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:45.432177 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2685a0e3-463a-4297-8d87-dc33237a6cad tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:45.440096 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2685a0e3-463a-4297-8d87-dc33237a6cad tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1672 microversion: 2.1 time: 0.191837 May 13 13:27:45.440667 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 293/595] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:45 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1672 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:46.236240 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f1b432e5-1f99-4a53-90e9-7b52febdfdee tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:46.236888 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f1b432e5-1f99-4a53-90e9-7b52febdfdee tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:46.244334 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f1b432e5-1f99-4a53-90e9-7b52febdfdee tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:46.247436 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f1b432e5-1f99-4a53-90e9-7b52febdfdee tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:46.247436 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f1b432e5-1f99-4a53-90e9-7b52febdfdee tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:46.247436 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f1b432e5-1f99-4a53-90e9-7b52febdfdee tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:46.380989 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-bd7bb2d7-e100-4cd2-aa26-f3c5ac7894b2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1441775329", "imageRef": "ece294e8-5415-4d6a-a0d3-a14539c51c0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc71e07c-eb5e-4e51-82e1-4253b2766878"}], "security_groups": [{"name": "tempest-securitygroup--2097878758"}], "key_name": "tempest-keypair-1998875009", "user_data": "}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:46.413666 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f1b432e5-1f99-4a53-90e9-7b52febdfdee tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:46.423380 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f1b432e5-1f99-4a53-90e9-7b52febdfdee tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:46.425126 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f1b432e5-1f99-4a53-90e9-7b52febdfdee tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:46.426331 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f1b432e5-1f99-4a53-90e9-7b52febdfdee tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1407 microversion: 2.20 time: 0.194033 May 13 13:27:46.426888 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 303/596] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:27:46 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:46.457350 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-93a39d2e-970d-44b5-8750-97e41ecb9637 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:46.458043 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-93a39d2e-970d-44b5-8750-97e41ecb9637 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:46.464294 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-93a39d2e-970d-44b5-8750-97e41ecb9637 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:46.464851 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-93a39d2e-970d-44b5-8750-97e41ecb9637 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:46.466237 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-93a39d2e-970d-44b5-8750-97e41ecb9637 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:46.466924 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-93a39d2e-970d-44b5-8750-97e41ecb9637 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:46.499164 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.network.neutron [None req-bd7bb2d7-e100-4cd2-aa26-f3c5ac7894b2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] validate_networks() for [('fc71e07c-eb5e-4e51-82e1-4253b2766878', None, None, None, None, None)] {{(pid=117720) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:27:46.717666 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-93a39d2e-970d-44b5-8750-97e41ecb9637 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:46.727935 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-93a39d2e-970d-44b5-8750-97e41ecb9637 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1672 microversion: 2.1 time: 0.274545 May 13 13:27:46.738023 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 304/597] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:46 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1672 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:46.978185 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-bd7bb2d7-e100-4cd2-aa26-f3c5ac7894b2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Flavor limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:27:46.978895 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-bd7bb2d7-e100-4cd2-aa26-f3c5ac7894b2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Image limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:27:46.979442 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-bd7bb2d7-e100-4cd2-aa26-f3c5ac7894b2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Flavor pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:27:46.979861 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-bd7bb2d7-e100-4cd2-aa26-f3c5ac7894b2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Image pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:27:46.980269 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-bd7bb2d7-e100-4cd2-aa26-f3c5ac7894b2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:27:46.991671 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bd7bb2d7-e100-4cd2-aa26-f3c5ac7894b2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:46.992246 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bd7bb2d7-e100-4cd2-aa26-f3c5ac7894b2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:46.993053 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bd7bb2d7-e100-4cd2-aa26-f3c5ac7894b2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:46.993483 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bd7bb2d7-e100-4cd2-aa26-f3c5ac7894b2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:47.018441 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-bd7bb2d7-e100-4cd2-aa26-f3c5ac7894b2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Getting quotas for project 2c900748e271404bb3cb11fb2308e784. Resources: {'cores', 'instances', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:27:47.022881 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-bd7bb2d7-e100-4cd2-aa26-f3c5ac7894b2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Getting quotas for user e25df7c837584b19afe274f6edfb8efd and project 2c900748e271404bb3cb11fb2308e784. Resources: {'cores', 'instances', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:27:47.034626 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-bd7bb2d7-e100-4cd2-aa26-f3c5ac7894b2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Going to run 1 instances... {{(pid=117720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:27:47.036938 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-bd7bb2d7-e100-4cd2-aa26-f3c5ac7894b2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ece294e8-5415-4d6a-a0d3-a14539c51c0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:27:47.193805 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-bd7bb2d7-e100-4cd2-aa26-f3c5ac7894b2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.812229 May 13 13:27:47.204859 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 294/598] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 13 13:27:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:27:47.210777 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-587ae890-73a4-485d-a109-184fbf52fe33 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:47.211486 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-587ae890-73a4-485d-a109-184fbf52fe33 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:47.260601 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-26d41f63-93d6-49f0-9d3e-ec3ef962d279 req-3d9d2883-b6e8-41e5-a89e-4feabb90b76c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2c2709-a695-4f16-a0fa-fed674cfab86", "name": "network-vif-deleted", "tag": "bb022415-b3c9-4b44-a6e4-3190a75170e0"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:47.277497 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-26d41f63-93d6-49f0-9d3e-ec3ef962d279 req-3d9d2883-b6e8-41e5-a89e-4feabb90b76c service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:47.285750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-26d41f63-93d6-49f0-9d3e-ec3ef962d279 req-3d9d2883-b6e8-41e5-a89e-4feabb90b76c service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:47.301475 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-26d41f63-93d6-49f0-9d3e-ec3ef962d279 req-3d9d2883-b6e8-41e5-a89e-4feabb90b76c service nova] Creating event network-vif-deleted:bb022415-b3c9-4b44-a6e4-3190a75170e0 for instance 3b2c2709-a695-4f16-a0fa-fed674cfab86 on hv-cinder-84163 May 13 13:27:47.315869 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-26d41f63-93d6-49f0-9d3e-ec3ef962d279 req-3d9d2883-b6e8-41e5-a89e-4feabb90b76c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055782 May 13 13:27:47.315869 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 295/599] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:27:47.320479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-587ae890-73a4-485d-a109-184fbf52fe33 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:47.333335 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-587ae890-73a4-485d-a109-184fbf52fe33 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819" status: 200 len: 1242 microversion: 2.1 time: 0.126710 May 13 13:27:47.334678 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 305/600] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:47 2022] GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819 => generated 1242 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:47.447580 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8be4fd20-df00-404d-9514-b0aeb7125290 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:47.448286 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8be4fd20-df00-404d-9514-b0aeb7125290 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:47.455956 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8be4fd20-df00-404d-9514-b0aeb7125290 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:47.456416 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8be4fd20-df00-404d-9514-b0aeb7125290 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:47.457227 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8be4fd20-df00-404d-9514-b0aeb7125290 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:47.457692 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8be4fd20-df00-404d-9514-b0aeb7125290 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:47.617537 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8be4fd20-df00-404d-9514-b0aeb7125290 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:47.627070 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8be4fd20-df00-404d-9514-b0aeb7125290 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:47.628943 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8be4fd20-df00-404d-9514-b0aeb7125290 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:47.630268 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8be4fd20-df00-404d-9514-b0aeb7125290 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1407 microversion: 2.20 time: 0.187845 May 13 13:27:47.630831 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 296/601] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:27:47 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:47.748498 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-132638af-d240-4e3d-b136-556ccd8f71d0 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:47.749098 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-132638af-d240-4e3d-b136-556ccd8f71d0 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:47.756212 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-132638af-d240-4e3d-b136-556ccd8f71d0 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:47.756642 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-132638af-d240-4e3d-b136-556ccd8f71d0 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:47.757411 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-132638af-d240-4e3d-b136-556ccd8f71d0 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:47.757984 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-132638af-d240-4e3d-b136-556ccd8f71d0 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:47.796480 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-132638af-d240-4e3d-b136-556ccd8f71d0 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:47.796933 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-132638af-d240-4e3d-b136-556ccd8f71d0 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:47.797387 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-132638af-d240-4e3d-b136-556ccd8f71d0 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lazy-loading 'fault' on Instance uuid 3b2c2709-a695-4f16-a0fa-fed674cfab86 {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:27:47.848554 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-132638af-d240-4e3d-b136-556ccd8f71d0 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:47.864442 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-132638af-d240-4e3d-b136-556ccd8f71d0 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 200 len: 1327 microversion: 2.1 time: 0.120740 May 13 13:27:47.865030 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 306/602] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:47 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 1327 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:47.912145 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e6df7413-716c-4aa0-b498-d427ccde6564 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-938255839", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1509969682", "security_groups": [{"name": "tempest-secgroup-smoke-2069208029"}], "networks": [{"uuid": "498b7ab4-2c71-4d7f-b37f-0a809c2f973a"}], "block_device_mapping_v2": [{"uuid": "006681b2-fffa-4d26-9432-4e4c113d0ce3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:48.042906 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.network.neutron [None req-e6df7413-716c-4aa0-b498-d427ccde6564 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] validate_networks() for [('498b7ab4-2c71-4d7f-b37f-0a809c2f973a', None, None, None, None, None)] {{(pid=117720) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:27:48.350471 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8a14a6ec-f29b-443c-8420-f418bb01a22b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:48.352906 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8a14a6ec-f29b-443c-8420-f418bb01a22b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:48.360946 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a14a6ec-f29b-443c-8420-f418bb01a22b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:48.362110 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a14a6ec-f29b-443c-8420-f418bb01a22b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:48.363340 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a14a6ec-f29b-443c-8420-f418bb01a22b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:48.364018 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a14a6ec-f29b-443c-8420-f418bb01a22b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:48.653734 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8a14a6ec-f29b-443c-8420-f418bb01a22b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:48.660915 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8a14a6ec-f29b-443c-8420-f418bb01a22b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819" status: 200 len: 1246 microversion: 2.1 time: 0.314290 May 13 13:27:48.662381 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 307/603] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:48 2022] GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819 => generated 1246 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:48.667790 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6d08773c-ea3c-41a9-a3d2-2485e4f6ccc6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:48.668581 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6d08773c-ea3c-41a9-a3d2-2485e4f6ccc6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:48.676240 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6d08773c-ea3c-41a9-a3d2-2485e4f6ccc6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:48.676918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6d08773c-ea3c-41a9-a3d2-2485e4f6ccc6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:48.677700 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6d08773c-ea3c-41a9-a3d2-2485e4f6ccc6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:48.678345 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6d08773c-ea3c-41a9-a3d2-2485e4f6ccc6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:48.705973 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-e6df7413-716c-4aa0-b498-d427ccde6564 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Flavor limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:27:48.707369 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-e6df7413-716c-4aa0-b498-d427ccde6564 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Image limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:27:48.708071 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-e6df7413-716c-4aa0-b498-d427ccde6564 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Flavor pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:27:48.708743 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-e6df7413-716c-4aa0-b498-d427ccde6564 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Image pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:27:48.709373 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-e6df7413-716c-4aa0-b498-d427ccde6564 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:27:48.723006 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e6df7413-716c-4aa0-b498-d427ccde6564 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:48.724246 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e6df7413-716c-4aa0-b498-d427ccde6564 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:48.725448 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e6df7413-716c-4aa0-b498-d427ccde6564 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:48.726069 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e6df7413-716c-4aa0-b498-d427ccde6564 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:48.750859 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-e6df7413-716c-4aa0-b498-d427ccde6564 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Getting quotas for project 8286d953594e4d539ca45c8a98bd435c. Resources: {'cores', 'instances', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:27:48.756606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-e6df7413-716c-4aa0-b498-d427ccde6564 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Getting quotas for user 8e135e636ed64741a890205b367efd40 and project 8286d953594e4d539ca45c8a98bd435c. Resources: {'cores', 'instances', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:27:48.835202 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e6df7413-716c-4aa0-b498-d427ccde6564 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Going to run 1 instances... {{(pid=117720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:27:48.837984 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e6df7413-716c-4aa0-b498-d427ccde6564 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='006681b2-fffa-4d26-9432-4e4c113d0ce3',volume_size=None,volume_type=None)] {{(pid=117720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:27:48.839436 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6d08773c-ea3c-41a9-a3d2-2485e4f6ccc6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:48.849810 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6d08773c-ea3c-41a9-a3d2-2485e4f6ccc6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:48.851447 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6d08773c-ea3c-41a9-a3d2-2485e4f6ccc6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:48.853376 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6d08773c-ea3c-41a9-a3d2-2485e4f6ccc6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1407 microversion: 2.20 time: 0.189497 May 13 13:27:48.865252 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 308/604] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:27:48 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:48.889837 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ef537639-5052-4c5b-a060-3d034141303d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:48.890811 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ef537639-5052-4c5b-a060-3d034141303d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:48.897908 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ef537639-5052-4c5b-a060-3d034141303d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:48.898653 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ef537639-5052-4c5b-a060-3d034141303d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:48.899937 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ef537639-5052-4c5b-a060-3d034141303d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:48.900599 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ef537639-5052-4c5b-a060-3d034141303d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:48.918630 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-ef537639-5052-4c5b-a060-3d034141303d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] HTTP exception thrown: Instance 3b2c2709-a695-4f16-a0fa-fed674cfab86 could not be found. May 13 13:27:48.921016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ef537639-5052-4c5b-a060-3d034141303d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Request method failure captured: May 13 13:27:48.921016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 HTTP/1.1 May 13 13:27:48.921016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:27:48.921016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:27:48.921016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:27:48.921016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:27:48.921016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:27:48.921016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:27:48.921016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:27:48.921016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:27:48.921016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiflu_zHiDTPcgHev98jjKim4ikKsTwGUqkbSArV9_vg5rBUOnz9koE-ckeKuMG7_RRtuGWaHd2FJQfQqoEi8shYdlY3_cEzAJ1Pq1Wckt1SfbouazpWm-uvBx1I86FyxdYyd853RN2GT4weMNRJ--mwwqMbERy2QQw3xGT4ba7yvpXfs May 13 13:27:48.921016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:27:48.921016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:27:48.921016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:27:48.921016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:27:48.921016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:27:48.921016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:27:48.921016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: 6c22198af7e14553a967643df90e501f May 13 13:27:48.921016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeTestJSON-962224307 May 13 13:27:48.921016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:27:48.921016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:27:48.922858 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6c22198af7e14553a967643df90e501f", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6c22198af7e14553a967643df90e501f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6c22198af7e14553a967643df90e501f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6c22198af7e14553a967643df90e501f"}]}] May 13 13:27:48.922858 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeTestJSON-962224307 May 13 13:27:48.922858 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 6c22198af7e14553a967643df90e501f May 13 13:27:48.922858 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeTestJSON-962224307 May 13 13:27:48.922858 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeTestJSON-962224307-project May 13 13:27:48.922858 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:27:48.922858 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:27:48.922858 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: ba9e2d9bbf294793a494709efde09b83 May 13 13:27:48.922858 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeTestJSON-962224307-project May 13 13:27:48.922858 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: > May 13 13:27:48.922858 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Instance 3b2c2709-a695-4f16-a0fa-fed674cfab86 could not be found. May 13 13:27:48.922858 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': '3b2c2709-a695-4f16-a0fa-fed674cfab86'} May 13 13:27:48.924258 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:27:48.924258 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:27:48.924258 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:27:48.924258 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:27:48.924258 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:27:48.924258 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:27:48.924258 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:27:48.924258 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:27:48.924258 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:27:48.924258 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:27:48.924258 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b2c2709-a695-4f16-a0fa-fed674cfab86 could not be found. May 13 13:27:48.924258 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:27:48.924258 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:27:48.924258 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:27:48.924258 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:27:48.924258 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:27:48.924258 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:27:48.924258 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:27:48.924258 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:27:48.924258 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:27:48.926386 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:27:48.926386 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:27:48.926386 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:27:48.926386 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:27:48.926386 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:27:48.926386 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:27:48.926386 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:27:48.926386 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b2c2709-a695-4f16-a0fa-fed674cfab86 could not be found. May 13 13:27:48.926386 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:27:48.926386 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:27:48.926386 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:27:48.926386 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:27:48.926386 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:27:48.926386 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:27:48.926386 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:27:48.926386 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:27:48.926386 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b2c2709-a695-4f16-a0fa-fed674cfab86 could not be found. May 13 13:27:48.926386 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:27:48.929027 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ef537639-5052-4c5b-a060-3d034141303d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Returning 404 to user: Instance 3b2c2709-a695-4f16-a0fa-fed674cfab86 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:27:48.929321 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ef537639-5052-4c5b-a060-3d034141303d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 404 len: 111 microversion: 2.1 time: 0.046111 May 13 13:27:48.933779 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 309/605] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:48 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:27:48.939041 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6d92564e-a758-4e5e-a0ca-f6aa3f99732e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '.version_select at 0x7fb084aa6af0>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:49.110986 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6d92564e-a758-4e5e-a0ca-f6aa3f99732e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-339692382" status: 202 len: 0 microversion: 2.1 time: 0.175619 May 13 13:27:49.120581 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 310/606] 10.222.0.13 () {58 vars in 1217 bytes} [Fri May 13 13:27:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-339692382 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:27:49.525334 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e6df7413-716c-4aa0-b498-d427ccde6564 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.617708 May 13 13:27:49.532335 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 297/607] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 13 13:27:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 1625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 13:27:49.537643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2e3fe60b-b6bc-485d-a2ff-b51f551ce76f tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:49.538333 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2e3fe60b-b6bc-485d-a2ff-b51f551ce76f tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:49.615846 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2e3fe60b-b6bc-485d-a2ff-b51f551ce76f tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:49.633027 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2e3fe60b-b6bc-485d-a2ff-b51f551ce76f tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1088 microversion: 2.1 time: 0.099786 May 13 13:27:49.634799 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 311/608] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:49 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1088 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:49.680845 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ff33ea84-8c6d-4e71-b39a-8f4842cd5107 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:49.683263 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ff33ea84-8c6d-4e71-b39a-8f4842cd5107 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:49.694711 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ff33ea84-8c6d-4e71-b39a-8f4842cd5107 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:49.694980 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ff33ea84-8c6d-4e71-b39a-8f4842cd5107 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:49.695807 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ff33ea84-8c6d-4e71-b39a-8f4842cd5107 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:49.696745 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ff33ea84-8c6d-4e71-b39a-8f4842cd5107 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:49.793641 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ff33ea84-8c6d-4e71-b39a-8f4842cd5107 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:49.803359 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ff33ea84-8c6d-4e71-b39a-8f4842cd5107 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819" status: 200 len: 1294 microversion: 2.1 time: 0.128053 May 13 13:27:49.813869 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 298/609] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:49 2022] GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819 => generated 1294 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:49.873928 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-489469cd-120c-4752-91c9-54bf9e5d9a18 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:49.874539 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-489469cd-120c-4752-91c9-54bf9e5d9a18 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:49.880939 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-489469cd-120c-4752-91c9-54bf9e5d9a18 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:49.884450 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-489469cd-120c-4752-91c9-54bf9e5d9a18 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:49.884450 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-489469cd-120c-4752-91c9-54bf9e5d9a18 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:49.884450 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-489469cd-120c-4752-91c9-54bf9e5d9a18 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:50.088441 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-489469cd-120c-4752-91c9-54bf9e5d9a18 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:50.097980 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-489469cd-120c-4752-91c9-54bf9e5d9a18 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:50.099527 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-489469cd-120c-4752-91c9-54bf9e5d9a18 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:50.100855 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-489469cd-120c-4752-91c9-54bf9e5d9a18 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1407 microversion: 2.20 time: 0.231733 May 13 13:27:50.112134 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 312/610] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:27:49 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:50.145812 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5ab5bd7f-958a-4566-b2a7-2565f3f65126 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Action: 'create', calling method: .version_select at 0x7fb08411f9d0>, body: {"keypair": {"name": "tempest-keypair-927254874", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClZ1COUwavwdw3HbzHq6sTxMyCcPH7U6p24D36XLocGOfjMoWsSwAY4aOILxbIRVqZO9ug1ja9rKk+cZHNIFzwTQvElbiSly62TjQbUWGX3GVPJSLyA+6WjGdaUKOSXgQ=="}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:50.162570 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-5ab5bd7f-958a-4566-b2a7-2565f3f65126 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Getting quotas for project 6c22198af7e14553a967643df90e501f. Resources: {'key_pairs'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:27:50.166595 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-5ab5bd7f-958a-4566-b2a7-2565f3f65126 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Getting quotas for user ba9e2d9bbf294793a494709efde09b83 and project 6c22198af7e14553a967643df90e501f. Resources: {'key_pairs'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:27:50.307558 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5ab5bd7f-958a-4566-b2a7-2565f3f65126 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.165652 May 13 13:27:50.313914 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 299/611] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 13 13:27:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:27:50.651720 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6b37d0fe-2083-4c3c-99a4-b4d7ac39768d tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:50.652367 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6b37d0fe-2083-4c3c-99a4-b4d7ac39768d tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:50.740333 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6b37d0fe-2083-4c3c-99a4-b4d7ac39768d tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:50.750115 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6b37d0fe-2083-4c3c-99a4-b4d7ac39768d tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1088 microversion: 2.1 time: 0.100275 May 13 13:27:50.750115 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 313/612] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:50 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1088 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:50.826355 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b9a3f006-a4d0-42d5-becd-3a267d7bf3e5 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:50.830303 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b9a3f006-a4d0-42d5-becd-3a267d7bf3e5 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:50.834238 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b9a3f006-a4d0-42d5-becd-3a267d7bf3e5 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:50.834949 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b9a3f006-a4d0-42d5-becd-3a267d7bf3e5 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:50.835855 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b9a3f006-a4d0-42d5-becd-3a267d7bf3e5 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:50.836409 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b9a3f006-a4d0-42d5-becd-3a267d7bf3e5 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:50.973312 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-9434d0b0-724a-4bfd-8566-11c8749101f7 req-72117ba9-99d1-450c-98f5-59b08ea1af8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "274c20ca-135a-48d9-85e5-7c99cf77f68d", "name": "network-vif-plugged", "status": "completed", "tag": "729dc6f6-46b1-4dac-a320-fa9e54753c1c"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:50.992298 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-9434d0b0-724a-4bfd-8566-11c8749101f7 req-72117ba9-99d1-450c-98f5-59b08ea1af8b service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:50.993060 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-9434d0b0-724a-4bfd-8566-11c8749101f7 req-72117ba9-99d1-450c-98f5-59b08ea1af8b service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:51.003248 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b9a3f006-a4d0-42d5-becd-3a267d7bf3e5 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:51.012155 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-9434d0b0-724a-4bfd-8566-11c8749101f7 req-72117ba9-99d1-450c-98f5-59b08ea1af8b service nova] Creating event network-vif-plugged:729dc6f6-46b1-4dac-a320-fa9e54753c1c for instance 274c20ca-135a-48d9-85e5-7c99cf77f68d on hv-cinder-84163 May 13 13:27:51.012423 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b9a3f006-a4d0-42d5-becd-3a267d7bf3e5 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819" status: 200 len: 1368 microversion: 2.1 time: 0.194334 May 13 13:27:51.016625 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-9434d0b0-724a-4bfd-8566-11c8749101f7 req-72117ba9-99d1-450c-98f5-59b08ea1af8b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048517 May 13 13:27:51.017895 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 314/613] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:27:51.022732 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 300/614] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:50 2022] GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819 => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:51.120728 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-257feb0a-c103-4557-95a7-1f29c2c04c3e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:51.121446 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-257feb0a-c103-4557-95a7-1f29c2c04c3e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:51.128824 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-257feb0a-c103-4557-95a7-1f29c2c04c3e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:51.129268 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-257feb0a-c103-4557-95a7-1f29c2c04c3e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:51.130270 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-257feb0a-c103-4557-95a7-1f29c2c04c3e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:51.130912 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-257feb0a-c103-4557-95a7-1f29c2c04c3e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:51.298691 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-257feb0a-c103-4557-95a7-1f29c2c04c3e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:51.308318 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-257feb0a-c103-4557-95a7-1f29c2c04c3e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:51.310709 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-257feb0a-c103-4557-95a7-1f29c2c04c3e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:51.311859 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-257feb0a-c103-4557-95a7-1f29c2c04c3e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1407 microversion: 2.20 time: 0.195841 May 13 13:27:51.312425 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 315/615] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:27:51 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:51.777637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1f212b3e-b4b3-41d5-90ca-a6f035d83eeb tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:51.779003 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1f212b3e-b4b3-41d5-90ca-a6f035d83eeb tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:51.792675 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1f212b3e-b4b3-41d5-90ca-a6f035d83eeb tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:51.793073 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1f212b3e-b4b3-41d5-90ca-a6f035d83eeb tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:51.795159 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1f212b3e-b4b3-41d5-90ca-a6f035d83eeb tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:51.795588 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1f212b3e-b4b3-41d5-90ca-a6f035d83eeb tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:51.873392 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1f212b3e-b4b3-41d5-90ca-a6f035d83eeb tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:51.881974 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1f212b3e-b4b3-41d5-90ca-a6f035d83eeb tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1130 microversion: 2.1 time: 0.115310 May 13 13:27:51.885858 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 301/616] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:51 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1130 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:52.031920 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b40485f0-efb4-4913-9b44-0027a914095b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:52.032522 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b40485f0-efb4-4913-9b44-0027a914095b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:52.044979 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-0eba9145-1525-4b25-a6ab-852081ff4b3c req-7a46d76f-05d5-4d58-9b89-05db883e2eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7d1447f-444f-4e0c-a20d-9350788fd819", "tag": "26a3043c-a71b-4f33-b912-ba88ebf29476"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:52.045279 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b40485f0-efb4-4913-9b44-0027a914095b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:52.046777 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b40485f0-efb4-4913-9b44-0027a914095b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:52.046777 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b40485f0-efb4-4913-9b44-0027a914095b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:52.046980 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b40485f0-efb4-4913-9b44-0027a914095b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:52.057060 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-0eba9145-1525-4b25-a6ab-852081ff4b3c req-7a46d76f-05d5-4d58-9b89-05db883e2eb4 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:52.058569 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-0eba9145-1525-4b25-a6ab-852081ff4b3c req-7a46d76f-05d5-4d58-9b89-05db883e2eb4 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:52.085223 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-0eba9145-1525-4b25-a6ab-852081ff4b3c req-7a46d76f-05d5-4d58-9b89-05db883e2eb4 service nova] Creating event network-changed:26a3043c-a71b-4f33-b912-ba88ebf29476 for instance f7d1447f-444f-4e0c-a20d-9350788fd819 on hv-cinder-84163 May 13 13:27:52.092125 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-0eba9145-1525-4b25-a6ab-852081ff4b3c req-7a46d76f-05d5-4d58-9b89-05db883e2eb4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050866 May 13 13:27:52.094566 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 302/617] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:27:52.273424 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b40485f0-efb4-4913-9b44-0027a914095b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:52.283940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b40485f0-efb4-4913-9b44-0027a914095b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819" status: 200 len: 1368 microversion: 2.1 time: 0.257343 May 13 13:27:52.284528 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 316/618] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:52 2022] GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819 => generated 1368 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:52.331796 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f03e7df5-4170-4d7e-bbe3-b775ae97a2b7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:52.332592 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f03e7df5-4170-4d7e-bbe3-b775ae97a2b7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:52.339253 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f03e7df5-4170-4d7e-bbe3-b775ae97a2b7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:52.339702 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f03e7df5-4170-4d7e-bbe3-b775ae97a2b7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:52.340492 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f03e7df5-4170-4d7e-bbe3-b775ae97a2b7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:52.340966 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f03e7df5-4170-4d7e-bbe3-b775ae97a2b7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:52.536261 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f03e7df5-4170-4d7e-bbe3-b775ae97a2b7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:52.544604 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f03e7df5-4170-4d7e-bbe3-b775ae97a2b7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:52.546049 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f03e7df5-4170-4d7e-bbe3-b775ae97a2b7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:52.547219 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f03e7df5-4170-4d7e-bbe3-b775ae97a2b7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1407 microversion: 2.20 time: 0.219845 May 13 13:27:52.547776 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 303/619] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:27:52 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:52.904973 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1de4a77d-8f6e-42aa-a7fb-6b054cbd7f88 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:52.905975 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1de4a77d-8f6e-42aa-a7fb-6b054cbd7f88 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:52.912383 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1de4a77d-8f6e-42aa-a7fb-6b054cbd7f88 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:52.913230 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1de4a77d-8f6e-42aa-a7fb-6b054cbd7f88 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:52.914061 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1de4a77d-8f6e-42aa-a7fb-6b054cbd7f88 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:52.914525 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1de4a77d-8f6e-42aa-a7fb-6b054cbd7f88 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:52.986777 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1de4a77d-8f6e-42aa-a7fb-6b054cbd7f88 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:52.994364 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1de4a77d-8f6e-42aa-a7fb-6b054cbd7f88 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1186 microversion: 2.1 time: 0.093891 May 13 13:27:52.994942 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 317/620] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:52 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1186 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:53.301799 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-794d8b14-422a-401b-99ec-a150c57c80ae tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:53.302635 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-794d8b14-422a-401b-99ec-a150c57c80ae tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:53.309158 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-794d8b14-422a-401b-99ec-a150c57c80ae tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:53.310069 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-794d8b14-422a-401b-99ec-a150c57c80ae tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:53.310956 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-794d8b14-422a-401b-99ec-a150c57c80ae tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:53.311398 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-794d8b14-422a-401b-99ec-a150c57c80ae tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:53.462018 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f66f3e42-2dc5-49b8-baf2-6aa02ccd4dad tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1346111699", "imageRef": "ece294e8-5415-4d6a-a0d3-a14539c51c0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8aa2b23b-91f7-4a69-a9b1-4be5eb2deeeb"}], "security_groups": [{"name": "tempest-securitygroup--1911620015"}], "key_name": "tempest-keypair-927254874", "user_data": "}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:53.492491 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-794d8b14-422a-401b-99ec-a150c57c80ae tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:53.500644 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-794d8b14-422a-401b-99ec-a150c57c80ae tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819" status: 200 len: 1368 microversion: 2.1 time: 0.202605 May 13 13:27:53.502176 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 304/621] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:53 2022] GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819 => generated 1368 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:53.572392 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-dbe07d0f-6509-45cf-abce-97a2c39cf3f1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:53.574063 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-dbe07d0f-6509-45cf-abce-97a2c39cf3f1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:53.582472 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dbe07d0f-6509-45cf-abce-97a2c39cf3f1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:53.583340 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dbe07d0f-6509-45cf-abce-97a2c39cf3f1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:53.584742 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dbe07d0f-6509-45cf-abce-97a2c39cf3f1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:53.585431 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dbe07d0f-6509-45cf-abce-97a2c39cf3f1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:53.589499 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.network.neutron [None req-f66f3e42-2dc5-49b8-baf2-6aa02ccd4dad tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] validate_networks() for [('8aa2b23b-91f7-4a69-a9b1-4be5eb2deeeb', None, None, None, None, None)] {{(pid=117721) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:27:53.808992 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dbe07d0f-6509-45cf-abce-97a2c39cf3f1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:53.818951 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dbe07d0f-6509-45cf-abce-97a2c39cf3f1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:53.820686 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dbe07d0f-6509-45cf-abce-97a2c39cf3f1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:53.822012 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-dbe07d0f-6509-45cf-abce-97a2c39cf3f1 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1598 microversion: 2.20 time: 0.258408 May 13 13:27:53.822789 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 305/622] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:27:53 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1598 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:53.842183 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a05207eb-2022-45c3-b08f-336ee74ff1bf tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:53.843060 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a05207eb-2022-45c3-b08f-336ee74ff1bf tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:53.850298 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a05207eb-2022-45c3-b08f-336ee74ff1bf tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:53.850908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a05207eb-2022-45c3-b08f-336ee74ff1bf tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:53.852637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a05207eb-2022-45c3-b08f-336ee74ff1bf tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:53.853091 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a05207eb-2022-45c3-b08f-336ee74ff1bf tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:53.983452 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a05207eb-2022-45c3-b08f-336ee74ff1bf tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.145430 May 13 13:27:53.984219 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 306/623] 10.222.0.13 () {60 vars in 1315 bytes} [Fri May 13 13:27:53 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 13:27:54.012381 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-44a3c19a-a321-47f6-b37e-5f17d246729f tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:54.013630 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-44a3c19a-a321-47f6-b37e-5f17d246729f tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:54.020992 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-44a3c19a-a321-47f6-b37e-5f17d246729f tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:54.021440 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-44a3c19a-a321-47f6-b37e-5f17d246729f tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:54.022244 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-44a3c19a-a321-47f6-b37e-5f17d246729f tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:54.022710 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-44a3c19a-a321-47f6-b37e-5f17d246729f tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:54.128324 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-44a3c19a-a321-47f6-b37e-5f17d246729f tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:54.136722 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-44a3c19a-a321-47f6-b37e-5f17d246729f tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1204 microversion: 2.1 time: 0.128470 May 13 13:27:54.137316 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 307/624] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:54 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1204 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:54.167104 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-f66f3e42-2dc5-49b8-baf2-6aa02ccd4dad tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Flavor limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:27:54.167659 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-f66f3e42-2dc5-49b8-baf2-6aa02ccd4dad tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Image limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:27:54.168234 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-f66f3e42-2dc5-49b8-baf2-6aa02ccd4dad tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Flavor pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:27:54.169345 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-f66f3e42-2dc5-49b8-baf2-6aa02ccd4dad tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Image pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:27:54.169865 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-f66f3e42-2dc5-49b8-baf2-6aa02ccd4dad tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:27:54.182606 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f66f3e42-2dc5-49b8-baf2-6aa02ccd4dad tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:54.188532 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f66f3e42-2dc5-49b8-baf2-6aa02ccd4dad tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:54.188532 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f66f3e42-2dc5-49b8-baf2-6aa02ccd4dad tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:54.188532 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f66f3e42-2dc5-49b8-baf2-6aa02ccd4dad tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:54.203046 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-f66f3e42-2dc5-49b8-baf2-6aa02ccd4dad tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Getting quotas for project 6c22198af7e14553a967643df90e501f. Resources: {'cores', 'instances', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:27:54.208439 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-f66f3e42-2dc5-49b8-baf2-6aa02ccd4dad tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Getting quotas for user ba9e2d9bbf294793a494709efde09b83 and project 6c22198af7e14553a967643df90e501f. Resources: {'cores', 'instances', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:27:54.223423 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f66f3e42-2dc5-49b8-baf2-6aa02ccd4dad tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Going to run 1 instances... {{(pid=117721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:27:54.226002 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f66f3e42-2dc5-49b8-baf2-6aa02ccd4dad tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ece294e8-5415-4d6a-a0d3-a14539c51c0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:27:54.435790 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f66f3e42-2dc5-49b8-baf2-6aa02ccd4dad tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.980584 May 13 13:27:54.436634 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 318/625] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 13 13:27:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 13:27:54.446780 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-df1951bd-2f09-4518-8763-61040bc614a1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:54.448086 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-df1951bd-2f09-4518-8763-61040bc614a1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:54.510020 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-df1951bd-2f09-4518-8763-61040bc614a1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:54.517700 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-df1951bd-2f09-4518-8763-61040bc614a1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6" status: 200 len: 1237 microversion: 2.1 time: 0.074710 May 13 13:27:54.517927 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1380c351-0000-4f20-911b-dc6a6f71a98f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:54.518487 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1380c351-0000-4f20-911b-dc6a6f71a98f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:54.519347 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 308/626] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:54 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6 => generated 1237 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:54.525749 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1380c351-0000-4f20-911b-dc6a6f71a98f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:54.527064 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1380c351-0000-4f20-911b-dc6a6f71a98f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:54.528611 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1380c351-0000-4f20-911b-dc6a6f71a98f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:54.529205 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1380c351-0000-4f20-911b-dc6a6f71a98f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:54.676784 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1380c351-0000-4f20-911b-dc6a6f71a98f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:54.684706 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1380c351-0000-4f20-911b-dc6a6f71a98f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819" status: 200 len: 1368 microversion: 2.1 time: 0.170515 May 13 13:27:54.685288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 319/627] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:54 2022] GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:55.154808 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-69ca10ad-1767-4b00-9904-7f572050ce3b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:55.157961 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-69ca10ad-1767-4b00-9904-7f572050ce3b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:55.162212 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-69ca10ad-1767-4b00-9904-7f572050ce3b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:55.162765 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-69ca10ad-1767-4b00-9904-7f572050ce3b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:55.163825 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-69ca10ad-1767-4b00-9904-7f572050ce3b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:55.164334 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-69ca10ad-1767-4b00-9904-7f572050ce3b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:55.324209 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-69ca10ad-1767-4b00-9904-7f572050ce3b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:55.334161 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-69ca10ad-1767-4b00-9904-7f572050ce3b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1272 microversion: 2.1 time: 0.184206 May 13 13:27:55.337386 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 309/628] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:55 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1272 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:55.535561 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e13af07e-9f1c-490e-9c32-5e11e5e04f32 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:55.536758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e13af07e-9f1c-490e-9c32-5e11e5e04f32 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:55.542975 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e13af07e-9f1c-490e-9c32-5e11e5e04f32 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:55.543430 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e13af07e-9f1c-490e-9c32-5e11e5e04f32 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:55.546074 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e13af07e-9f1c-490e-9c32-5e11e5e04f32 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:55.546074 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e13af07e-9f1c-490e-9c32-5e11e5e04f32 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:55.617487 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e13af07e-9f1c-490e-9c32-5e11e5e04f32 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:55.625971 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e13af07e-9f1c-490e-9c32-5e11e5e04f32 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6" status: 200 len: 1241 microversion: 2.1 time: 0.094354 May 13 13:27:55.626614 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 320/629] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:55 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6 => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:55.705732 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f8bf41b8-6149-4d9b-8e7c-a1bdeaa31a60 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:55.706947 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f8bf41b8-6149-4d9b-8e7c-a1bdeaa31a60 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:55.714823 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f8bf41b8-6149-4d9b-8e7c-a1bdeaa31a60 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:55.722683 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f8bf41b8-6149-4d9b-8e7c-a1bdeaa31a60 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:55.722683 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f8bf41b8-6149-4d9b-8e7c-a1bdeaa31a60 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:55.722683 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f8bf41b8-6149-4d9b-8e7c-a1bdeaa31a60 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:55.755353 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-8d935987-9f88-42b0-9231-a13af16d6f0a req-9891735a-8a5d-4c4e-b141-1be3b3f85795 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "274c20ca-135a-48d9-85e5-7c99cf77f68d", "tag": "729dc6f6-46b1-4dac-a320-fa9e54753c1c"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:55.765856 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-8d935987-9f88-42b0-9231-a13af16d6f0a req-9891735a-8a5d-4c4e-b141-1be3b3f85795 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:55.766483 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-8d935987-9f88-42b0-9231-a13af16d6f0a req-9891735a-8a5d-4c4e-b141-1be3b3f85795 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:55.786420 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-8d935987-9f88-42b0-9231-a13af16d6f0a req-9891735a-8a5d-4c4e-b141-1be3b3f85795 service nova] Creating event network-changed:729dc6f6-46b1-4dac-a320-fa9e54753c1c for instance 274c20ca-135a-48d9-85e5-7c99cf77f68d on hv-cinder-84163 May 13 13:27:55.793043 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-8d935987-9f88-42b0-9231-a13af16d6f0a req-9891735a-8a5d-4c4e-b141-1be3b3f85795 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041361 May 13 13:27:55.795459 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 321/630] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:27:55.923016 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f8bf41b8-6149-4d9b-8e7c-a1bdeaa31a60 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:55.930920 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f8bf41b8-6149-4d9b-8e7c-a1bdeaa31a60 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819" status: 200 len: 1368 microversion: 2.1 time: 0.231033 May 13 13:27:55.931842 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 310/631] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:55 2022] GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819 => generated 1368 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:56.358117 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7b0d9f4a-ae0a-45fb-98c8-48763039c621 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:56.359084 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7b0d9f4a-ae0a-45fb-98c8-48763039c621 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:56.366718 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7b0d9f4a-ae0a-45fb-98c8-48763039c621 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:56.367249 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7b0d9f4a-ae0a-45fb-98c8-48763039c621 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:56.368189 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7b0d9f4a-ae0a-45fb-98c8-48763039c621 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:56.368764 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7b0d9f4a-ae0a-45fb-98c8-48763039c621 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:56.523236 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7b0d9f4a-ae0a-45fb-98c8-48763039c621 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:56.531388 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7b0d9f4a-ae0a-45fb-98c8-48763039c621 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1260 microversion: 2.1 time: 0.183173 May 13 13:27:56.531974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 322/632] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:56 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:56.650982 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-cb302361-d5fb-420b-a5ad-d2b1b558392b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:56.655543 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-cb302361-d5fb-420b-a5ad-d2b1b558392b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:56.668645 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cb302361-d5fb-420b-a5ad-d2b1b558392b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:56.668645 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cb302361-d5fb-420b-a5ad-d2b1b558392b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:56.675244 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cb302361-d5fb-420b-a5ad-d2b1b558392b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:56.676140 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cb302361-d5fb-420b-a5ad-d2b1b558392b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:56.790997 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-cb302361-d5fb-420b-a5ad-d2b1b558392b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:56.802971 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-cb302361-d5fb-420b-a5ad-d2b1b558392b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6" status: 200 len: 1289 microversion: 2.1 time: 0.163012 May 13 13:27:56.805724 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 311/633] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:56 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6 => generated 1289 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:56.949461 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-35557480-c42e-424f-89ec-2e382887ccbb tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:56.950852 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-35557480-c42e-424f-89ec-2e382887ccbb tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:56.957724 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-35557480-c42e-424f-89ec-2e382887ccbb tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:56.962392 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-35557480-c42e-424f-89ec-2e382887ccbb tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:56.962392 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-35557480-c42e-424f-89ec-2e382887ccbb tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:56.962392 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-35557480-c42e-424f-89ec-2e382887ccbb tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:57.138304 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-35557480-c42e-424f-89ec-2e382887ccbb tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:57.146613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-35557480-c42e-424f-89ec-2e382887ccbb tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819" status: 200 len: 1368 microversion: 2.1 time: 0.201087 May 13 13:27:57.156679 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 323/634] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:56 2022] GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819 => generated 1368 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:57.549920 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-39653d0a-0d3e-4480-8efe-d6bda60a4d80 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:57.550558 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-39653d0a-0d3e-4480-8efe-d6bda60a4d80 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:57.556815 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-39653d0a-0d3e-4480-8efe-d6bda60a4d80 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:57.557253 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-39653d0a-0d3e-4480-8efe-d6bda60a4d80 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:57.558233 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-39653d0a-0d3e-4480-8efe-d6bda60a4d80 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:57.558802 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-39653d0a-0d3e-4480-8efe-d6bda60a4d80 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:57.699007 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-39653d0a-0d3e-4480-8efe-d6bda60a4d80 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:57.706857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-39653d0a-0d3e-4480-8efe-d6bda60a4d80 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1260 microversion: 2.1 time: 0.161190 May 13 13:27:57.707450 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 312/635] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:57 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:57.812071 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-2d7c2423-33d6-432a-a2b4-fc67dab5d4cf req-be805b30-e4c9-4ae8-8528-e096af23e07a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f4be22-416d-4465-9e39-d09271f63511", "tag": "7ceff24a-7ce2-4184-bc2c-ed2f493ac946"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:57.820817 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-2d7c2423-33d6-432a-a2b4-fc67dab5d4cf req-be805b30-e4c9-4ae8-8528-e096af23e07a service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:57.821258 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-2d7c2423-33d6-432a-a2b4-fc67dab5d4cf req-be805b30-e4c9-4ae8-8528-e096af23e07a service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:57.822361 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-fa4c34f0-b7d0-447c-bb89-e8eec7dd33d9 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:57.823279 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-fa4c34f0-b7d0-447c-bb89-e8eec7dd33d9 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:57.847193 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-2d7c2423-33d6-432a-a2b4-fc67dab5d4cf req-be805b30-e4c9-4ae8-8528-e096af23e07a service nova] Creating event network-changed:7ceff24a-7ce2-4184-bc2c-ed2f493ac946 for instance 58f4be22-416d-4465-9e39-d09271f63511 on hv-cinder-84163 May 13 13:27:57.850663 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fa4c34f0-b7d0-447c-bb89-e8eec7dd33d9 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:57.851452 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fa4c34f0-b7d0-447c-bb89-e8eec7dd33d9 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:57.852372 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-2d7c2423-33d6-432a-a2b4-fc67dab5d4cf req-be805b30-e4c9-4ae8-8528-e096af23e07a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044253 May 13 13:27:57.852556 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fa4c34f0-b7d0-447c-bb89-e8eec7dd33d9 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:57.853140 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fa4c34f0-b7d0-447c-bb89-e8eec7dd33d9 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:57.853329 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 324/636] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:27:57.922090 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fa4c34f0-b7d0-447c-bb89-e8eec7dd33d9 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:57.930346 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-fa4c34f0-b7d0-447c-bb89-e8eec7dd33d9 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6" status: 200 len: 1295 microversion: 2.1 time: 0.112179 May 13 13:27:57.930969 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 313/637] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:57 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6 => generated 1295 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:58.164459 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-404b0071-ff4a-40f0-811a-6a2d468c9e84 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:58.165154 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-404b0071-ff4a-40f0-811a-6a2d468c9e84 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:58.171948 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-404b0071-ff4a-40f0-811a-6a2d468c9e84 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:58.172431 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-404b0071-ff4a-40f0-811a-6a2d468c9e84 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:58.173205 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-404b0071-ff4a-40f0-811a-6a2d468c9e84 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:58.173639 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-404b0071-ff4a-40f0-811a-6a2d468c9e84 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:58.332291 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-404b0071-ff4a-40f0-811a-6a2d468c9e84 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:58.348594 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-404b0071-ff4a-40f0-811a-6a2d468c9e84 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819" status: 200 len: 1368 microversion: 2.1 time: 0.182312 May 13 13:27:58.348594 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 325/638] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:58 2022] GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819 => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:58.726370 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2d841a6b-1ec6-4021-833d-73d0bb0d2030 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:58.727148 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2d841a6b-1ec6-4021-833d-73d0bb0d2030 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:58.734762 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2d841a6b-1ec6-4021-833d-73d0bb0d2030 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:58.735462 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2d841a6b-1ec6-4021-833d-73d0bb0d2030 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:58.736234 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2d841a6b-1ec6-4021-833d-73d0bb0d2030 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:58.736768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2d841a6b-1ec6-4021-833d-73d0bb0d2030 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:58.962566 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a7755fc8-bf39-44f4-9bf2-734bfe2ef047 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:58.962566 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a7755fc8-bf39-44f4-9bf2-734bfe2ef047 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:58.963193 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a7755fc8-bf39-44f4-9bf2-734bfe2ef047 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:58.963837 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a7755fc8-bf39-44f4-9bf2-734bfe2ef047 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:58.966045 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a7755fc8-bf39-44f4-9bf2-734bfe2ef047 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:58.967054 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a7755fc8-bf39-44f4-9bf2-734bfe2ef047 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:59.092675 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2d841a6b-1ec6-4021-833d-73d0bb0d2030 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:59.111481 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2d841a6b-1ec6-4021-833d-73d0bb0d2030 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1260 microversion: 2.1 time: 0.389885 May 13 13:27:59.119908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 314/639] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:58 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1260 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:59.119908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-325bb777-4717-4d91-8fc5-1c66a4d53e0d req-6a7e08bb-6f48-4f14-839a-adcb3ecf327d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d1447f-444f-4e0c-a20d-9350788fd819", "name": "network-vif-plugged", "status": "completed", "tag": "26a3043c-a71b-4f33-b912-ba88ebf29476"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:59.134244 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-325bb777-4717-4d91-8fc5-1c66a4d53e0d req-6a7e08bb-6f48-4f14-839a-adcb3ecf327d service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:59.135692 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-325bb777-4717-4d91-8fc5-1c66a4d53e0d req-6a7e08bb-6f48-4f14-839a-adcb3ecf327d service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:59.150301 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-325bb777-4717-4d91-8fc5-1c66a4d53e0d req-6a7e08bb-6f48-4f14-839a-adcb3ecf327d service nova] Creating event network-vif-plugged:26a3043c-a71b-4f33-b912-ba88ebf29476 for instance f7d1447f-444f-4e0c-a20d-9350788fd819 on hv-cinder-84163 May 13 13:27:59.156886 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-325bb777-4717-4d91-8fc5-1c66a4d53e0d req-6a7e08bb-6f48-4f14-839a-adcb3ecf327d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042872 May 13 13:27:59.158229 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 315/640] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:27:59.285663 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a7755fc8-bf39-44f4-9bf2-734bfe2ef047 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:59.293528 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a7755fc8-bf39-44f4-9bf2-734bfe2ef047 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6" status: 200 len: 1363 microversion: 2.1 time: 0.345835 May 13 13:27:59.295411 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 326/641] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:58 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6 => generated 1363 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:59.361444 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a67802bf-5dbf-4313-850b-fcb33698b9af tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:59.362187 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a67802bf-5dbf-4313-850b-fcb33698b9af tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:59.370161 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a67802bf-5dbf-4313-850b-fcb33698b9af tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:59.370677 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a67802bf-5dbf-4313-850b-fcb33698b9af tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:59.371555 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a67802bf-5dbf-4313-850b-fcb33698b9af tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:59.372176 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a67802bf-5dbf-4313-850b-fcb33698b9af tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:59.518557 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a67802bf-5dbf-4313-850b-fcb33698b9af tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:59.526448 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a67802bf-5dbf-4313-850b-fcb33698b9af tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819" status: 200 len: 1368 microversion: 2.1 time: 0.170288 May 13 13:27:59.527047 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 316/642] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:27:59 2022] GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:59.910665 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-1d4d5ba0-e6a6-44ab-8b7e-9df85eec4f09 req-d9a1a33d-d8e8-4c2a-9345-2fd6181738b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2660342-b571-4b93-bef3-025664cd9ad6", "tag": "782846b6-0b62-4309-96f8-442c19de620e"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:59.920701 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-1d4d5ba0-e6a6-44ab-8b7e-9df85eec4f09 req-d9a1a33d-d8e8-4c2a-9345-2fd6181738b6 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:59.921177 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-1d4d5ba0-e6a6-44ab-8b7e-9df85eec4f09 req-d9a1a33d-d8e8-4c2a-9345-2fd6181738b6 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:59.935863 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-1d4d5ba0-e6a6-44ab-8b7e-9df85eec4f09 req-d9a1a33d-d8e8-4c2a-9345-2fd6181738b6 service nova] Creating event network-changed:782846b6-0b62-4309-96f8-442c19de620e for instance a2660342-b571-4b93-bef3-025664cd9ad6 on hv-cinder-84163 May 13 13:27:59.941527 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-1d4d5ba0-e6a6-44ab-8b7e-9df85eec4f09 req-d9a1a33d-d8e8-4c2a-9345-2fd6181738b6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040001 May 13 13:27:59.942140 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 327/643] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:28:00.130271 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-55d846c2-8b02-4b44-8e1f-22c5c6db6f78 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:00.130929 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-55d846c2-8b02-4b44-8e1f-22c5c6db6f78 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:00.138504 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-55d846c2-8b02-4b44-8e1f-22c5c6db6f78 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:00.138962 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-55d846c2-8b02-4b44-8e1f-22c5c6db6f78 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:00.139748 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-55d846c2-8b02-4b44-8e1f-22c5c6db6f78 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:00.140181 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-55d846c2-8b02-4b44-8e1f-22c5c6db6f78 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:00.280923 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-55d846c2-8b02-4b44-8e1f-22c5c6db6f78 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:00.288421 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-55d846c2-8b02-4b44-8e1f-22c5c6db6f78 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1260 microversion: 2.1 time: 0.163513 May 13 13:28:00.290001 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 317/644] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:00 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:00.312626 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8c2d68fe-6fdf-4d36-90c5-ea3ec49dc3f4 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:00.313317 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8c2d68fe-6fdf-4d36-90c5-ea3ec49dc3f4 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:00.319967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c2d68fe-6fdf-4d36-90c5-ea3ec49dc3f4 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:00.320532 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c2d68fe-6fdf-4d36-90c5-ea3ec49dc3f4 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:00.321175 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c2d68fe-6fdf-4d36-90c5-ea3ec49dc3f4 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:00.321603 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c2d68fe-6fdf-4d36-90c5-ea3ec49dc3f4 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:00.463264 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8c2d68fe-6fdf-4d36-90c5-ea3ec49dc3f4 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:00.472076 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8c2d68fe-6fdf-4d36-90c5-ea3ec49dc3f4 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6" status: 200 len: 1363 microversion: 2.1 time: 0.163583 May 13 13:28:00.473377 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 328/645] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:00 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:00.545788 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-20d0f043-5942-4496-95b6-e228f1dd2dac tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:00.546511 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-20d0f043-5942-4496-95b6-e228f1dd2dac tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:00.553683 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-20d0f043-5942-4496-95b6-e228f1dd2dac tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:00.554132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-20d0f043-5942-4496-95b6-e228f1dd2dac tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:00.555187 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-20d0f043-5942-4496-95b6-e228f1dd2dac tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:00.555625 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-20d0f043-5942-4496-95b6-e228f1dd2dac tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:00.708249 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-20d0f043-5942-4496-95b6-e228f1dd2dac tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:00.717953 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-20d0f043-5942-4496-95b6-e228f1dd2dac tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819" status: 200 len: 1368 microversion: 2.1 time: 0.175886 May 13 13:28:00.718661 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 318/646] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:00 2022] GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819 => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:01.305830 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2e361eb6-bddd-4416-bac2-bf85f8af3026 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:01.306712 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2e361eb6-bddd-4416-bac2-bf85f8af3026 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:01.320639 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2e361eb6-bddd-4416-bac2-bf85f8af3026 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:01.321290 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2e361eb6-bddd-4416-bac2-bf85f8af3026 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:01.321873 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2e361eb6-bddd-4416-bac2-bf85f8af3026 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:01.322336 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2e361eb6-bddd-4416-bac2-bf85f8af3026 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:01.463033 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2e361eb6-bddd-4416-bac2-bf85f8af3026 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:01.471077 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2e361eb6-bddd-4416-bac2-bf85f8af3026 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1260 microversion: 2.1 time: 0.169207 May 13 13:28:01.471814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 329/647] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:01 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:01.488760 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c37b3e76-4b88-4182-9888-e02754af0335 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:01.489372 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c37b3e76-4b88-4182-9888-e02754af0335 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:01.496073 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c37b3e76-4b88-4182-9888-e02754af0335 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:01.496520 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c37b3e76-4b88-4182-9888-e02754af0335 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:01.497476 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c37b3e76-4b88-4182-9888-e02754af0335 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:01.497912 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c37b3e76-4b88-4182-9888-e02754af0335 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:01.633670 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c37b3e76-4b88-4182-9888-e02754af0335 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:01.642834 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c37b3e76-4b88-4182-9888-e02754af0335 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6" status: 200 len: 1363 microversion: 2.1 time: 0.157697 May 13 13:28:01.643821 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 319/648] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:01 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:01.735380 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b0489df4-9668-44fd-aaf3-fb5da221958c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:01.735988 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b0489df4-9668-44fd-aaf3-fb5da221958c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:01.744411 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b0489df4-9668-44fd-aaf3-fb5da221958c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:01.744411 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b0489df4-9668-44fd-aaf3-fb5da221958c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:01.745056 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b0489df4-9668-44fd-aaf3-fb5da221958c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:01.745485 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b0489df4-9668-44fd-aaf3-fb5da221958c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:01.886192 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b0489df4-9668-44fd-aaf3-fb5da221958c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:01.894472 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b0489df4-9668-44fd-aaf3-fb5da221958c tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819" status: 200 len: 1557 microversion: 2.1 time: 0.163023 May 13 13:28:01.895045 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 330/649] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:01 2022] GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819 => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:01.911468 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c3022cba-136e-41b7-b449-2e88a46b45b7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:01.911956 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c3022cba-136e-41b7-b449-2e88a46b45b7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:01.918345 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c3022cba-136e-41b7-b449-2e88a46b45b7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:01.919015 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c3022cba-136e-41b7-b449-2e88a46b45b7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:01.920392 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c3022cba-136e-41b7-b449-2e88a46b45b7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:01.920826 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c3022cba-136e-41b7-b449-2e88a46b45b7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:02.005105 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c3022cba-136e-41b7-b449-2e88a46b45b7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097450 May 13 13:28:02.005734 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 320/650] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 13 13:28:01 2022] GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:28:02.488051 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-18d2a573-d6a5-42e2-8be5-6090c3dcb2aa tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:02.488667 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-18d2a573-d6a5-42e2-8be5-6090c3dcb2aa tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:02.495605 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-18d2a573-d6a5-42e2-8be5-6090c3dcb2aa tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:02.496031 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-18d2a573-d6a5-42e2-8be5-6090c3dcb2aa tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:02.496825 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-18d2a573-d6a5-42e2-8be5-6090c3dcb2aa tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:02.498028 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-18d2a573-d6a5-42e2-8be5-6090c3dcb2aa tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:02.660569 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-94707b09-01e4-4330-9b29-2b5497cfb1df tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:02.661286 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-94707b09-01e4-4330-9b29-2b5497cfb1df tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:02.667672 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-94707b09-01e4-4330-9b29-2b5497cfb1df tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:02.668122 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-94707b09-01e4-4330-9b29-2b5497cfb1df tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:02.669644 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-94707b09-01e4-4330-9b29-2b5497cfb1df tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:02.670084 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-94707b09-01e4-4330-9b29-2b5497cfb1df tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:02.780290 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-18d2a573-d6a5-42e2-8be5-6090c3dcb2aa tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:02.787862 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-18d2a573-d6a5-42e2-8be5-6090c3dcb2aa tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1260 microversion: 2.1 time: 0.303698 May 13 13:28:02.788654 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 331/651] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:02 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1260 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:02.900049 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-94707b09-01e4-4330-9b29-2b5497cfb1df tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:02.908447 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-94707b09-01e4-4330-9b29-2b5497cfb1df tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6" status: 200 len: 1363 microversion: 2.1 time: 0.252109 May 13 13:28:02.909029 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 321/652] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:02 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:03.037771 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-deb99e99-7273-452c-8509-624b25d23e25 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:03.038173 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-deb99e99-7273-452c-8509-624b25d23e25 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:03.045986 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-deb99e99-7273-452c-8509-624b25d23e25 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:03.046459 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-deb99e99-7273-452c-8509-624b25d23e25 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:03.047233 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-deb99e99-7273-452c-8509-624b25d23e25 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:03.047660 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-deb99e99-7273-452c-8509-624b25d23e25 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:03.134073 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-deb99e99-7273-452c-8509-624b25d23e25 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lazy-loading 'services' on Instance uuid ba162312-5c53-4320-acc9-4e2566f27686 {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:28:03.369162 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-deb99e99-7273-452c-8509-624b25d23e25 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686/os-volume_attachments/fe934b4a-f4cf-4a6f-9853-00dc7081a0d1" status: 202 len: 0 microversion: 2.1 time: 0.335351 May 13 13:28:03.369828 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 332/653] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 13 13:28:03 2022] DELETE /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686/os-volume_attachments/fe934b4a-f4cf-4a6f-9853-00dc7081a0d1 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:28:03.379894 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-aa19a983-affc-4b39-bdc6-896d00bca216 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:03.380983 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-aa19a983-affc-4b39-bdc6-896d00bca216 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:03.387195 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-aa19a983-affc-4b39-bdc6-896d00bca216 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:03.388928 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-aa19a983-affc-4b39-bdc6-896d00bca216 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:03.389733 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-aa19a983-affc-4b39-bdc6-896d00bca216 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:03.390172 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-aa19a983-affc-4b39-bdc6-896d00bca216 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:03.424720 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-aa19a983-affc-4b39-bdc6-896d00bca216 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048815 May 13 13:28:03.428474 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 322/654] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 13 13:28:03 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:28:03.472229 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-a0b147db-3017-411b-813c-e0a394041c1e req-b0517372-a68f-4e5f-a0e9-39a59e993392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7d1447f-444f-4e0c-a20d-9350788fd819", "tag": "26a3043c-a71b-4f33-b912-ba88ebf29476"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:28:03.481969 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-a0b147db-3017-411b-813c-e0a394041c1e req-b0517372-a68f-4e5f-a0e9-39a59e993392 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:03.482606 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-a0b147db-3017-411b-813c-e0a394041c1e req-b0517372-a68f-4e5f-a0e9-39a59e993392 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:03.495123 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-a0b147db-3017-411b-813c-e0a394041c1e req-b0517372-a68f-4e5f-a0e9-39a59e993392 service nova] Creating event network-changed:26a3043c-a71b-4f33-b912-ba88ebf29476 for instance f7d1447f-444f-4e0c-a20d-9350788fd819 on hv-cinder-84163 May 13 13:28:03.501623 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-a0b147db-3017-411b-813c-e0a394041c1e req-b0517372-a68f-4e5f-a0e9-39a59e993392 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033934 May 13 13:28:03.502328 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 333/655] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:28:03.804991 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1c43383c-cca3-45fe-ba0d-aee23b62c065 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:03.805692 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1c43383c-cca3-45fe-ba0d-aee23b62c065 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:03.813753 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1c43383c-cca3-45fe-ba0d-aee23b62c065 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:03.814207 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1c43383c-cca3-45fe-ba0d-aee23b62c065 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:03.815019 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1c43383c-cca3-45fe-ba0d-aee23b62c065 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:03.815459 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1c43383c-cca3-45fe-ba0d-aee23b62c065 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:03.926813 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d2a13c63-a447-466d-bfca-efea0dcb2919 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:03.927836 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d2a13c63-a447-466d-bfca-efea0dcb2919 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:03.936297 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d2a13c63-a447-466d-bfca-efea0dcb2919 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:03.936754 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d2a13c63-a447-466d-bfca-efea0dcb2919 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:03.937867 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d2a13c63-a447-466d-bfca-efea0dcb2919 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:03.938351 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d2a13c63-a447-466d-bfca-efea0dcb2919 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:03.956884 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1c43383c-cca3-45fe-ba0d-aee23b62c065 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:03.969625 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1c43383c-cca3-45fe-ba0d-aee23b62c065 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1260 microversion: 2.1 time: 0.168389 May 13 13:28:03.970711 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 323/656] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:03 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:04.085549 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d2a13c63-a447-466d-bfca-efea0dcb2919 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:04.094295 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d2a13c63-a447-466d-bfca-efea0dcb2919 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6" status: 200 len: 1363 microversion: 2.1 time: 0.172108 May 13 13:28:04.094912 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 334/657] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:03 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:04.436848 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0b984fb0-b5fd-4cea-b562-473f89af0d15 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:04.437799 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0b984fb0-b5fd-4cea-b562-473f89af0d15 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:04.443970 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0b984fb0-b5fd-4cea-b562-473f89af0d15 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:04.444431 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0b984fb0-b5fd-4cea-b562-473f89af0d15 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:04.445192 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0b984fb0-b5fd-4cea-b562-473f89af0d15 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:04.445622 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0b984fb0-b5fd-4cea-b562-473f89af0d15 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:04.479430 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0b984fb0-b5fd-4cea-b562-473f89af0d15 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046887 May 13 13:28:04.480204 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 324/658] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 13 13:28:04 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:28:04.987396 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b866addb-62ef-4569-8781-fb124481e100 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:04.987988 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b866addb-62ef-4569-8781-fb124481e100 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:05.005539 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b866addb-62ef-4569-8781-fb124481e100 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:05.006340 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b866addb-62ef-4569-8781-fb124481e100 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:05.007235 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b866addb-62ef-4569-8781-fb124481e100 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:05.007671 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b866addb-62ef-4569-8781-fb124481e100 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:05.111856 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1fb6d1f4-05f4-4e2d-a625-dcb88f2dbd68 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:05.112482 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1fb6d1f4-05f4-4e2d-a625-dcb88f2dbd68 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:05.119280 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1fb6d1f4-05f4-4e2d-a625-dcb88f2dbd68 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:05.119736 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1fb6d1f4-05f4-4e2d-a625-dcb88f2dbd68 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:05.120516 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1fb6d1f4-05f4-4e2d-a625-dcb88f2dbd68 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:05.120953 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1fb6d1f4-05f4-4e2d-a625-dcb88f2dbd68 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:05.173211 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b866addb-62ef-4569-8781-fb124481e100 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:05.181442 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b866addb-62ef-4569-8781-fb124481e100 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1260 microversion: 2.1 time: 0.198316 May 13 13:28:05.186244 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 335/659] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:04 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:05.263604 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1fb6d1f4-05f4-4e2d-a625-dcb88f2dbd68 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:05.272587 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1fb6d1f4-05f4-4e2d-a625-dcb88f2dbd68 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6" status: 200 len: 1363 microversion: 2.1 time: 0.164791 May 13 13:28:05.273942 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 325/660] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:05 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:05.491031 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7c498766-a6aa-4d19-b0f1-80f41458cbae tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:05.492082 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7c498766-a6aa-4d19-b0f1-80f41458cbae tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:05.498889 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7c498766-a6aa-4d19-b0f1-80f41458cbae tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:05.499340 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7c498766-a6aa-4d19-b0f1-80f41458cbae tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:05.500123 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7c498766-a6aa-4d19-b0f1-80f41458cbae tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:05.500555 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7c498766-a6aa-4d19-b0f1-80f41458cbae tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:05.532432 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7c498766-a6aa-4d19-b0f1-80f41458cbae tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045284 May 13 13:28:05.536123 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 336/661] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 13 13:28:05 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 13:28:05.611203 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2d133f3d-9950-420a-b6a9-b47e45c959e6 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:05.611695 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2d133f3d-9950-420a-b6a9-b47e45c959e6 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:05.617794 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2d133f3d-9950-420a-b6a9-b47e45c959e6 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:05.618276 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2d133f3d-9950-420a-b6a9-b47e45c959e6 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:05.619047 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2d133f3d-9950-420a-b6a9-b47e45c959e6 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:05.619555 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2d133f3d-9950-420a-b6a9-b47e45c959e6 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:05.645330 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2d133f3d-9950-420a-b6a9-b47e45c959e6 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Going to try to terminate instance {{(pid=117720) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:28:05.998854 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2d133f3d-9950-420a-b6a9-b47e45c959e6 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 204 len: 0 microversion: 2.1 time: 0.392661 May 13 13:28:05.999455 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 326/662] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:28:05 2022] DELETE /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:28:06.008309 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-54159f3d-4714-4f1a-8fdb-ca33bae3a09f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:06.008987 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-54159f3d-4714-4f1a-8fdb-ca33bae3a09f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:06.016507 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-54159f3d-4714-4f1a-8fdb-ca33bae3a09f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:06.017768 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-54159f3d-4714-4f1a-8fdb-ca33bae3a09f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:06.018961 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-54159f3d-4714-4f1a-8fdb-ca33bae3a09f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:06.019410 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-54159f3d-4714-4f1a-8fdb-ca33bae3a09f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:06.158760 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-54159f3d-4714-4f1a-8fdb-ca33bae3a09f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:06.166856 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-54159f3d-4714-4f1a-8fdb-ca33bae3a09f tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1689 microversion: 2.1 time: 0.162243 May 13 13:28:06.167440 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 337/663] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:06 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:06.202661 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-64e8da1a-f141-4dc1-994b-838e6f14870c tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:06.203366 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-64e8da1a-f141-4dc1-994b-838e6f14870c tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:06.210349 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-64e8da1a-f141-4dc1-994b-838e6f14870c tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:06.210797 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-64e8da1a-f141-4dc1-994b-838e6f14870c tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:06.211582 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-64e8da1a-f141-4dc1-994b-838e6f14870c tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:06.212046 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-64e8da1a-f141-4dc1-994b-838e6f14870c tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:06.289238 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-576b97e5-656c-4ab8-b60c-f00c3d025953 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:06.289765 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-576b97e5-656c-4ab8-b60c-f00c3d025953 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:06.297758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-576b97e5-656c-4ab8-b60c-f00c3d025953 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:06.298229 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-576b97e5-656c-4ab8-b60c-f00c3d025953 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:06.299033 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-576b97e5-656c-4ab8-b60c-f00c3d025953 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:06.299465 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-576b97e5-656c-4ab8-b60c-f00c3d025953 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:06.385658 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-64e8da1a-f141-4dc1-994b-838e6f14870c tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:06.394044 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-64e8da1a-f141-4dc1-994b-838e6f14870c tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1260 microversion: 2.1 time: 0.196209 May 13 13:28:06.394650 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 327/664] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:06 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:06.451532 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-576b97e5-656c-4ab8-b60c-f00c3d025953 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:06.459176 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-576b97e5-656c-4ab8-b60c-f00c3d025953 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6" status: 200 len: 1363 microversion: 2.1 time: 0.173978 May 13 13:28:06.462540 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 338/665] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:06 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:07.085783 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-4086eaf9-3e05-446d-a9bb-a294aac6cff7 req-b197d0e3-fcc2-4549-b6b9-133644d564d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2660342-b571-4b93-bef3-025664cd9ad6", "name": "network-vif-plugged", "status": "completed", "tag": "782846b6-0b62-4309-96f8-442c19de620e"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:28:07.094471 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-4086eaf9-3e05-446d-a9bb-a294aac6cff7 req-b197d0e3-fcc2-4549-b6b9-133644d564d6 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:07.094906 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-4086eaf9-3e05-446d-a9bb-a294aac6cff7 req-b197d0e3-fcc2-4549-b6b9-133644d564d6 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:07.105908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-4086eaf9-3e05-446d-a9bb-a294aac6cff7 req-b197d0e3-fcc2-4549-b6b9-133644d564d6 service nova] Creating event network-vif-plugged:782846b6-0b62-4309-96f8-442c19de620e for instance a2660342-b571-4b93-bef3-025664cd9ad6 on hv-cinder-84163 May 13 13:28:07.111353 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-4086eaf9-3e05-446d-a9bb-a294aac6cff7 req-b197d0e3-fcc2-4549-b6b9-133644d564d6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029517 May 13 13:28:07.111981 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 328/666] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:28:07.184016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8a794bc0-2bfe-42bd-a299-607e9daed412 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:07.185784 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8a794bc0-2bfe-42bd-a299-607e9daed412 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:07.193203 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a794bc0-2bfe-42bd-a299-607e9daed412 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:07.193667 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a794bc0-2bfe-42bd-a299-607e9daed412 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:07.195401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a794bc0-2bfe-42bd-a299-607e9daed412 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:07.195912 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a794bc0-2bfe-42bd-a299-607e9daed412 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:07.342650 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8a794bc0-2bfe-42bd-a299-607e9daed412 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:07.350695 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8a794bc0-2bfe-42bd-a299-607e9daed412 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1689 microversion: 2.1 time: 0.170562 May 13 13:28:07.351284 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 339/667] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:07 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:07.411609 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-fff56a3e-1ead-45c8-ae16-9465242bc64e tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:07.412265 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-fff56a3e-1ead-45c8-ae16-9465242bc64e tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:07.419841 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fff56a3e-1ead-45c8-ae16-9465242bc64e tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:07.420294 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fff56a3e-1ead-45c8-ae16-9465242bc64e tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:07.421083 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fff56a3e-1ead-45c8-ae16-9465242bc64e tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:07.421517 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fff56a3e-1ead-45c8-ae16-9465242bc64e tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:07.477015 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-49647b42-6183-4e69-89b8-3c892dfe74c3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:07.477884 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-49647b42-6183-4e69-89b8-3c892dfe74c3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:07.485462 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-49647b42-6183-4e69-89b8-3c892dfe74c3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:07.486154 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-49647b42-6183-4e69-89b8-3c892dfe74c3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:07.487128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-49647b42-6183-4e69-89b8-3c892dfe74c3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:07.487567 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-49647b42-6183-4e69-89b8-3c892dfe74c3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:07.608581 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fff56a3e-1ead-45c8-ae16-9465242bc64e tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:07.617083 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-fff56a3e-1ead-45c8-ae16-9465242bc64e tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1260 microversion: 2.1 time: 0.209637 May 13 13:28:07.617677 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 329/668] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:07 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1260 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:07.656844 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-49647b42-6183-4e69-89b8-3c892dfe74c3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:07.664624 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-49647b42-6183-4e69-89b8-3c892dfe74c3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6" status: 200 len: 1363 microversion: 2.1 time: 0.191442 May 13 13:28:07.665115 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 340/669] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:07 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:08.368693 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f320c48f-76f5-4402-9f46-f0b29fce51f5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:08.369443 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f320c48f-76f5-4402-9f46-f0b29fce51f5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:08.376101 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f320c48f-76f5-4402-9f46-f0b29fce51f5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:08.376539 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f320c48f-76f5-4402-9f46-f0b29fce51f5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:08.377476 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f320c48f-76f5-4402-9f46-f0b29fce51f5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:08.377903 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f320c48f-76f5-4402-9f46-f0b29fce51f5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:08.514460 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f320c48f-76f5-4402-9f46-f0b29fce51f5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:08.521903 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f320c48f-76f5-4402-9f46-f0b29fce51f5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1689 microversion: 2.1 time: 0.157187 May 13 13:28:08.522508 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 330/670] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:08 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:08.634979 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-55799ab5-ecfb-46c6-922f-11d71a298662 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:08.635545 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-55799ab5-ecfb-46c6-922f-11d71a298662 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:08.642065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-55799ab5-ecfb-46c6-922f-11d71a298662 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:08.642537 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-55799ab5-ecfb-46c6-922f-11d71a298662 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:08.643334 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-55799ab5-ecfb-46c6-922f-11d71a298662 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:08.643767 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-55799ab5-ecfb-46c6-922f-11d71a298662 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:08.683087 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0ba24586-56f2-4c27-be06-de23b0273e91 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:08.683709 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0ba24586-56f2-4c27-be06-de23b0273e91 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:08.690659 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0ba24586-56f2-4c27-be06-de23b0273e91 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:08.691141 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0ba24586-56f2-4c27-be06-de23b0273e91 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:08.691911 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0ba24586-56f2-4c27-be06-de23b0273e91 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:08.692383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0ba24586-56f2-4c27-be06-de23b0273e91 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:08.832335 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-55799ab5-ecfb-46c6-922f-11d71a298662 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:08.841104 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-55799ab5-ecfb-46c6-922f-11d71a298662 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1260 microversion: 2.1 time: 0.209354 May 13 13:28:08.850573 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 341/671] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:08 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1260 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:08.869889 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0ba24586-56f2-4c27-be06-de23b0273e91 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:08.878977 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0ba24586-56f2-4c27-be06-de23b0273e91 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6" status: 200 len: 1363 microversion: 2.1 time: 0.198832 May 13 13:28:08.878977 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 331/672] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:08 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:09.125353 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-8edc54cc-c007-48c1-b06b-bca4b272c4ac req-0b54866d-b11a-4a9b-9600-ccda8bfd6d27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f4be22-416d-4465-9e39-d09271f63511", "name": "network-vif-plugged", "status": "completed", "tag": "7ceff24a-7ce2-4184-bc2c-ed2f493ac946"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:28:09.133403 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-8edc54cc-c007-48c1-b06b-bca4b272c4ac req-0b54866d-b11a-4a9b-9600-ccda8bfd6d27 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:09.133878 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-8edc54cc-c007-48c1-b06b-bca4b272c4ac req-0b54866d-b11a-4a9b-9600-ccda8bfd6d27 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:09.145263 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-8edc54cc-c007-48c1-b06b-bca4b272c4ac req-0b54866d-b11a-4a9b-9600-ccda8bfd6d27 service nova] Creating event network-vif-plugged:7ceff24a-7ce2-4184-bc2c-ed2f493ac946 for instance 58f4be22-416d-4465-9e39-d09271f63511 on hv-cinder-84163 May 13 13:28:09.150247 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-8edc54cc-c007-48c1-b06b-bca4b272c4ac req-0b54866d-b11a-4a9b-9600-ccda8bfd6d27 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028667 May 13 13:28:09.150844 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 342/673] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:28:09.542562 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d1303e2f-f70c-4320-a65a-84f9d9b1a2ee tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:09.543111 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d1303e2f-f70c-4320-a65a-84f9d9b1a2ee tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:09.550000 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d1303e2f-f70c-4320-a65a-84f9d9b1a2ee tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:09.550542 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d1303e2f-f70c-4320-a65a-84f9d9b1a2ee tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:09.551472 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d1303e2f-f70c-4320-a65a-84f9d9b1a2ee tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:09.552192 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d1303e2f-f70c-4320-a65a-84f9d9b1a2ee tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:09.713536 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d1303e2f-f70c-4320-a65a-84f9d9b1a2ee tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:09.722544 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d1303e2f-f70c-4320-a65a-84f9d9b1a2ee tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1689 microversion: 2.1 time: 0.184244 May 13 13:28:09.723137 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 332/674] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:09 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1689 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:09.859655 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-df4d3f19-055d-44af-b8a8-924c6a407cea tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:09.861028 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-df4d3f19-055d-44af-b8a8-924c6a407cea tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:09.869178 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df4d3f19-055d-44af-b8a8-924c6a407cea tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:09.870167 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df4d3f19-055d-44af-b8a8-924c6a407cea tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:09.871142 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df4d3f19-055d-44af-b8a8-924c6a407cea tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:09.871761 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df4d3f19-055d-44af-b8a8-924c6a407cea tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:09.897054 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ee5f382d-b973-46d8-98b7-d3dc78692593 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:09.897918 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ee5f382d-b973-46d8-98b7-d3dc78692593 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:09.907858 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ee5f382d-b973-46d8-98b7-d3dc78692593 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:09.908828 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ee5f382d-b973-46d8-98b7-d3dc78692593 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:09.909920 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ee5f382d-b973-46d8-98b7-d3dc78692593 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:09.910650 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ee5f382d-b973-46d8-98b7-d3dc78692593 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:10.087844 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-df4d3f19-055d-44af-b8a8-924c6a407cea tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:10.096612 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ee5f382d-b973-46d8-98b7-d3dc78692593 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:10.104343 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ee5f382d-b973-46d8-98b7-d3dc78692593 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6" status: 200 len: 1363 microversion: 2.1 time: 0.211923 May 13 13:28:10.106961 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-df4d3f19-055d-44af-b8a8-924c6a407cea tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1260 microversion: 2.1 time: 0.252783 May 13 13:28:10.107551 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 343/675] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:09 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1260 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:10.108368 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 333/676] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:09 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:10.740646 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-98cd470a-c020-4bf8-9bd5-14abad3bd130 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:10.741304 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-98cd470a-c020-4bf8-9bd5-14abad3bd130 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:10.748725 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-98cd470a-c020-4bf8-9bd5-14abad3bd130 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:10.749193 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-98cd470a-c020-4bf8-9bd5-14abad3bd130 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:10.749973 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-98cd470a-c020-4bf8-9bd5-14abad3bd130 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:10.750450 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-98cd470a-c020-4bf8-9bd5-14abad3bd130 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:10.822414 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-98cd470a-c020-4bf8-9bd5-14abad3bd130 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:10.831402 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-98cd470a-c020-4bf8-9bd5-14abad3bd130 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1622 microversion: 2.1 time: 0.094695 May 13 13:28:10.832181 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 334/677] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:10 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1622 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:11.124163 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-de232453-1399-4d26-bc48-6a306c504992 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:11.124979 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-de232453-1399-4d26-bc48-6a306c504992 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:11.128332 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c0be4251-f5cf-4cbe-8331-a21282a241a4 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:11.129194 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c0be4251-f5cf-4cbe-8331-a21282a241a4 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:11.132690 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-de232453-1399-4d26-bc48-6a306c504992 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:11.133342 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-de232453-1399-4d26-bc48-6a306c504992 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:11.134114 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-de232453-1399-4d26-bc48-6a306c504992 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:11.134579 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-de232453-1399-4d26-bc48-6a306c504992 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:11.140859 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c0be4251-f5cf-4cbe-8331-a21282a241a4 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:11.141540 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c0be4251-f5cf-4cbe-8331-a21282a241a4 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:11.142942 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c0be4251-f5cf-4cbe-8331-a21282a241a4 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:11.143664 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c0be4251-f5cf-4cbe-8331-a21282a241a4 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:11.388792 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-de232453-1399-4d26-bc48-6a306c504992 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:11.396779 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c0be4251-f5cf-4cbe-8331-a21282a241a4 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:11.399873 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-de232453-1399-4d26-bc48-6a306c504992 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1260 microversion: 2.1 time: 0.279044 May 13 13:28:11.400651 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 344/678] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:11 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1260 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:11.406435 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-dc02d6e2-5918-4fef-ae72-562385918dec req-280ae0b5-0fb8-48ce-bff5-98a927c7324f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba162312-5c53-4320-acc9-4e2566f27686", "name": "network-vif-deleted", "tag": "bc491e34-66dc-4f6f-9292-c68b5d9c9928"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:28:11.415387 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-dc02d6e2-5918-4fef-ae72-562385918dec req-280ae0b5-0fb8-48ce-bff5-98a927c7324f service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:11.415820 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-dc02d6e2-5918-4fef-ae72-562385918dec req-280ae0b5-0fb8-48ce-bff5-98a927c7324f service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:11.431156 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-dc02d6e2-5918-4fef-ae72-562385918dec req-280ae0b5-0fb8-48ce-bff5-98a927c7324f service nova] Creating event network-vif-deleted:bc491e34-66dc-4f6f-9292-c68b5d9c9928 for instance ba162312-5c53-4320-acc9-4e2566f27686 on hv-cinder-84163 May 13 13:28:11.431646 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c0be4251-f5cf-4cbe-8331-a21282a241a4 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6" status: 200 len: 1363 microversion: 2.1 time: 0.309280 May 13 13:28:11.432260 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 335/679] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:11 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6 => generated 1363 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:11.443940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-dc02d6e2-5918-4fef-ae72-562385918dec req-280ae0b5-0fb8-48ce-bff5-98a927c7324f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041910 May 13 13:28:11.444589 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 345/680] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:28:11.849298 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1bc0a313-94a0-4eb5-b074-3abc5d67309d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:11.850101 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1bc0a313-94a0-4eb5-b074-3abc5d67309d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:11.857637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1bc0a313-94a0-4eb5-b074-3abc5d67309d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:11.858387 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1bc0a313-94a0-4eb5-b074-3abc5d67309d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:11.859331 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1bc0a313-94a0-4eb5-b074-3abc5d67309d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:11.859763 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1bc0a313-94a0-4eb5-b074-3abc5d67309d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:11.925932 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1bc0a313-94a0-4eb5-b074-3abc5d67309d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:11.933842 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1bc0a313-94a0-4eb5-b074-3abc5d67309d tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1622 microversion: 2.1 time: 0.088575 May 13 13:28:11.935193 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 336/681] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:11 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1622 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:12.420042 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0a99e629-f45d-4b8c-b25b-833763966aa1 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:12.420928 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0a99e629-f45d-4b8c-b25b-833763966aa1 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:12.427997 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0a99e629-f45d-4b8c-b25b-833763966aa1 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:12.428451 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0a99e629-f45d-4b8c-b25b-833763966aa1 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:12.429243 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0a99e629-f45d-4b8c-b25b-833763966aa1 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:12.429906 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0a99e629-f45d-4b8c-b25b-833763966aa1 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:12.452034 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d55169a2-b36f-48ec-9c62-03cda2f842e7 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:12.453135 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d55169a2-b36f-48ec-9c62-03cda2f842e7 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:12.475561 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d55169a2-b36f-48ec-9c62-03cda2f842e7 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:12.476070 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d55169a2-b36f-48ec-9c62-03cda2f842e7 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:12.476888 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d55169a2-b36f-48ec-9c62-03cda2f842e7 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:12.480112 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d55169a2-b36f-48ec-9c62-03cda2f842e7 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:12.630498 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0a99e629-f45d-4b8c-b25b-833763966aa1 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:12.639422 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0a99e629-f45d-4b8c-b25b-833763966aa1 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1444 microversion: 2.1 time: 0.224688 May 13 13:28:12.640369 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 346/682] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:12 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1444 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:12.657025 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-176ef39b-62d9-42db-8801-57382277772a tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:12.657786 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-176ef39b-62d9-42db-8801-57382277772a tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:12.662357 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d55169a2-b36f-48ec-9c62-03cda2f842e7 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:12.663982 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-176ef39b-62d9-42db-8801-57382277772a tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:12.670504 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-176ef39b-62d9-42db-8801-57382277772a tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:12.670504 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-176ef39b-62d9-42db-8801-57382277772a tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:12.670504 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-176ef39b-62d9-42db-8801-57382277772a tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:12.670837 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d55169a2-b36f-48ec-9c62-03cda2f842e7 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6" status: 200 len: 1548 microversion: 2.1 time: 0.225532 May 13 13:28:12.671324 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 337/683] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:12 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6 => generated 1548 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:12.688857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4b469286-85ba-4a28-a238-70e22b58fcb8 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:12.689277 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4b469286-85ba-4a28-a238-70e22b58fcb8 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:12.696928 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4b469286-85ba-4a28-a238-70e22b58fcb8 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:12.697337 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4b469286-85ba-4a28-a238-70e22b58fcb8 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:12.698127 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4b469286-85ba-4a28-a238-70e22b58fcb8 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:12.698586 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4b469286-85ba-4a28-a238-70e22b58fcb8 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:12.811023 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-176ef39b-62d9-42db-8801-57382277772a tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:12.818966 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-176ef39b-62d9-42db-8801-57382277772a tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1444 microversion: 2.1 time: 0.166355 May 13 13:28:12.819833 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 347/684] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:12 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1444 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:12.864950 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4b469286-85ba-4a28-a238-70e22b58fcb8 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.181851 May 13 13:28:12.866009 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 338/685] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 13 13:28:12 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/os-interface => generated 284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:28:12.952874 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0fbe1da4-ff01-4a73-b358-65ac58c45265 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:12.954009 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0fbe1da4-ff01-4a73-b358-65ac58c45265 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:12.960594 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0fbe1da4-ff01-4a73-b358-65ac58c45265 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:12.961369 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0fbe1da4-ff01-4a73-b358-65ac58c45265 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:12.962154 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0fbe1da4-ff01-4a73-b358-65ac58c45265 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:12.962620 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0fbe1da4-ff01-4a73-b358-65ac58c45265 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:12.995853 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0fbe1da4-ff01-4a73-b358-65ac58c45265 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:12.996204 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0fbe1da4-ff01-4a73-b358-65ac58c45265 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:12.997307 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-0fbe1da4-ff01-4a73-b358-65ac58c45265 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lazy-loading 'fault' on Instance uuid ba162312-5c53-4320-acc9-4e2566f27686 {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:28:13.041612 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0fbe1da4-ff01-4a73-b358-65ac58c45265 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:13.051069 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0fbe1da4-ff01-4a73-b358-65ac58c45265 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 200 len: 1335 microversion: 2.1 time: 0.102819 May 13 13:28:13.051681 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 348/686] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:12 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 1335 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:14.069002 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3c745d41-9f1a-4115-b019-564f9b1e5138 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:14.069701 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3c745d41-9f1a-4115-b019-564f9b1e5138 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: ba162312-5c53-4320-acc9-4e2566f27686] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:14.076233 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3c745d41-9f1a-4115-b019-564f9b1e5138 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:14.076753 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3c745d41-9f1a-4115-b019-564f9b1e5138 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:14.077662 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3c745d41-9f1a-4115-b019-564f9b1e5138 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:14.078174 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3c745d41-9f1a-4115-b019-564f9b1e5138 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:14.092452 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-3c745d41-9f1a-4115-b019-564f9b1e5138 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] HTTP exception thrown: Instance ba162312-5c53-4320-acc9-4e2566f27686 could not be found. May 13 13:28:14.094074 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3c745d41-9f1a-4115-b019-564f9b1e5138 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Request method failure captured: May 13 13:28:14.094074 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 HTTP/1.1 May 13 13:28:14.094074 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept: application/json May 13 13:28:14.094074 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity May 13 13:28:14.094074 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Connection: close May 13 13:28:14.094074 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Length: 0 May 13 13:28:14.094074 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Type: application/json May 13 13:28:14.094074 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Host: 10.222.0.13 May 13 13:28:14.094074 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None May 13 13:28:14.094074 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 May 13 13:28:14.094074 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiflu9j1w3aWMYNeaepMtfghSN45R1rpudn7y88iUBZfUo5TNiFrmf5PObcCzu3o7oE_Enr4-R9iUAQxm1SnylSai1-YY48Gzh5RYsKm6vqseENGLkqnAve6m4Gli7NdrEPkNnXAnVdgHIyQUn7lwQz8bRkj2auUPtcvSEbefYCErLs1g May 13 13:28:14.094074 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Id: None May 13 13:28:14.094074 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Name: None May 13 13:28:14.094074 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed May 13 13:28:14.094074 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True May 13 13:28:14.094074 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default May 13 13:28:14.094074 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default May 13 13:28:14.094074 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Id: a0e165a1f0d34fca81de45a48c6cdbb9 May 13 13:28:14.094074 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2055800790 May 13 13:28:14.094074 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Role: member,reader May 13 13:28:14.094074 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Roles: member,reader May 13 13:28:14.095815 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a0e165a1f0d34fca81de45a48c6cdbb9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a0e165a1f0d34fca81de45a48c6cdbb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a0e165a1f0d34fca81de45a48c6cdbb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a0e165a1f0d34fca81de45a48c6cdbb9"}]}] May 13 13:28:14.095815 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2055800790 May 13 13:28:14.095815 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Id: a0e165a1f0d34fca81de45a48c6cdbb9 May 13 13:28:14.095815 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2055800790 May 13 13:28:14.095815 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User: tempest-ServerRescueNegativeTestJSON-2055800790-project May 13 13:28:14.095815 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default May 13 13:28:14.095815 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default May 13 13:28:14.095815 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Id: 805e8e6c39f94d3bbcf60930492e297c May 13 13:28:14.095815 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2055800790-project May 13 13:28:14.095815 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: method: > May 13 13:28:14.095815 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: exception: Instance ba162312-5c53-4320-acc9-4e2566f27686 could not be found. May 13 13:28:14.095815 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: action_args: {'id': 'ba162312-5c53-4320-acc9-4e2566f27686'} May 13 13:28:14.096606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:28:14.096606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:28:14.096606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:28:14.096606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:28:14.096606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:28:14.096606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:28:14.096606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:28:14.096606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:28:14.096606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:28:14.096606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:28:14.096606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba162312-5c53-4320-acc9-4e2566f27686 could not be found. May 13 13:28:14.096606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:28:14.096606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:28:14.096606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:28:14.096606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:28:14.096606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:28:14.096606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:28:14.096606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:28:14.096606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:28:14.096606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:28:14.097936 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:28:14.097936 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:28:14.097936 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:28:14.097936 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:28:14.097936 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:28:14.097936 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:28:14.097936 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:28:14.097936 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba162312-5c53-4320-acc9-4e2566f27686 could not be found. May 13 13:28:14.097936 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:28:14.097936 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:28:14.097936 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:28:14.097936 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:28:14.097936 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:28:14.097936 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:28:14.097936 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:28:14.097936 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:28:14.097936 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba162312-5c53-4320-acc9-4e2566f27686 could not be found. May 13 13:28:14.097936 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:28:14.099059 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3c745d41-9f1a-4115-b019-564f9b1e5138 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Returning 404 to user: Instance ba162312-5c53-4320-acc9-4e2566f27686 could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:28:14.099059 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3c745d41-9f1a-4115-b019-564f9b1e5138 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686" status: 404 len: 111 microversion: 2.1 time: 0.030854 May 13 13:28:14.099059 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 339/687] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:14 2022] GET /compute/v2.1/servers/ba162312-5c53-4320-acc9-4e2566f27686 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:28:14.104387 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e736b95e-eb26-48a9-b3ce-64cfdbcfc3c5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '.version_select at 0x7fb08946ea60>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:14.179750 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e736b95e-eb26-48a9-b3ce-64cfdbcfc3c5 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-325993084" status: 202 len: 0 microversion: 2.1 time: 0.078949 May 13 13:28:14.180672 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 349/688] 10.222.0.13 () {58 vars in 1217 bytes} [Fri May 13 13:28:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-325993084 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:28:14.766400 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-173c23c0-5cc8-40de-9c36-4c705ed12e19 req-6d622a9d-fe8c-4d5f-aaab-0c004ea46884 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2660342-b571-4b93-bef3-025664cd9ad6", "tag": "782846b6-0b62-4309-96f8-442c19de620e"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:28:14.777678 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-173c23c0-5cc8-40de-9c36-4c705ed12e19 req-6d622a9d-fe8c-4d5f-aaab-0c004ea46884 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:14.779527 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-173c23c0-5cc8-40de-9c36-4c705ed12e19 req-6d622a9d-fe8c-4d5f-aaab-0c004ea46884 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:14.792867 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-173c23c0-5cc8-40de-9c36-4c705ed12e19 req-6d622a9d-fe8c-4d5f-aaab-0c004ea46884 service nova] Creating event network-changed:782846b6-0b62-4309-96f8-442c19de620e for instance a2660342-b571-4b93-bef3-025664cd9ad6 on hv-cinder-84163 May 13 13:28:14.799509 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-173c23c0-5cc8-40de-9c36-4c705ed12e19 req-6d622a9d-fe8c-4d5f-aaab-0c004ea46884 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036926 May 13 13:28:14.801142 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 340/689] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:28:16.843133 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-5b8c75b4-ec1d-41fe-b030-0fb08852be35 req-60ab743c-9048-4295-b1d5-8fb5206224e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f4be22-416d-4465-9e39-d09271f63511", "tag": "7ceff24a-7ce2-4184-bc2c-ed2f493ac946"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:28:16.852578 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-5b8c75b4-ec1d-41fe-b030-0fb08852be35 req-60ab743c-9048-4295-b1d5-8fb5206224e1 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:16.853017 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-5b8c75b4-ec1d-41fe-b030-0fb08852be35 req-60ab743c-9048-4295-b1d5-8fb5206224e1 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:16.863663 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-5b8c75b4-ec1d-41fe-b030-0fb08852be35 req-60ab743c-9048-4295-b1d5-8fb5206224e1 service nova] Creating event network-changed:7ceff24a-7ce2-4184-bc2c-ed2f493ac946 for instance 58f4be22-416d-4465-9e39-d09271f63511 on hv-cinder-84163 May 13 13:28:16.868731 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-5b8c75b4-ec1d-41fe-b030-0fb08852be35 req-60ab743c-9048-4295-b1d5-8fb5206224e1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030481 May 13 13:28:16.869327 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 350/690] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:28:17.682313 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f5cabecc-d224-456d-8db9-29379870ef6e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:17.682925 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f5cabecc-d224-456d-8db9-29379870ef6e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:17.689677 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f5cabecc-d224-456d-8db9-29379870ef6e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:17.690119 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f5cabecc-d224-456d-8db9-29379870ef6e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:17.690912 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f5cabecc-d224-456d-8db9-29379870ef6e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:17.691346 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f5cabecc-d224-456d-8db9-29379870ef6e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:17.716694 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f5cabecc-d224-456d-8db9-29379870ef6e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Going to try to terminate instance {{(pid=117720) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:28:18.013050 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f5cabecc-d224-456d-8db9-29379870ef6e tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 204 len: 0 microversion: 2.1 time: 0.334048 May 13 13:28:18.013569 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 341/691] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:28:17 2022] DELETE /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:28:18.022717 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1f8a32fb-37a6-433a-95c6-809ae07cb5ad tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:18.023401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1f8a32fb-37a6-433a-95c6-809ae07cb5ad tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:18.030612 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1f8a32fb-37a6-433a-95c6-809ae07cb5ad tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:18.031070 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1f8a32fb-37a6-433a-95c6-809ae07cb5ad tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:18.031909 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1f8a32fb-37a6-433a-95c6-809ae07cb5ad tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:18.032368 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1f8a32fb-37a6-433a-95c6-809ae07cb5ad tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:18.170335 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1f8a32fb-37a6-433a-95c6-809ae07cb5ad tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:18.178027 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1f8a32fb-37a6-433a-95c6-809ae07cb5ad tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1509 microversion: 2.1 time: 0.160176 May 13 13:28:18.178619 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 351/692] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:18 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:19.195680 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1a2977e9-487a-4738-8198-c5f5bc51b796 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:19.196400 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1a2977e9-487a-4738-8198-c5f5bc51b796 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:19.203099 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1a2977e9-487a-4738-8198-c5f5bc51b796 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:19.203583 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1a2977e9-487a-4738-8198-c5f5bc51b796 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:19.204461 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1a2977e9-487a-4738-8198-c5f5bc51b796 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:19.204773 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1a2977e9-487a-4738-8198-c5f5bc51b796 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:19.336890 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1a2977e9-487a-4738-8198-c5f5bc51b796 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:19.346346 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1a2977e9-487a-4738-8198-c5f5bc51b796 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1509 microversion: 2.1 time: 0.155040 May 13 13:28:19.347002 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 342/693] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:19 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:20.363668 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cbb07e83-65e4-421a-a3a4-398a09042d72 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:20.364341 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-cbb07e83-65e4-421a-a3a4-398a09042d72 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:20.370924 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cbb07e83-65e4-421a-a3a4-398a09042d72 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:20.371397 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cbb07e83-65e4-421a-a3a4-398a09042d72 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:20.372216 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cbb07e83-65e4-421a-a3a4-398a09042d72 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:20.372651 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cbb07e83-65e4-421a-a3a4-398a09042d72 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:20.508521 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-cbb07e83-65e4-421a-a3a4-398a09042d72 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:20.516886 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-cbb07e83-65e4-421a-a3a4-398a09042d72 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1509 microversion: 2.1 time: 0.157274 May 13 13:28:20.517579 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 352/694] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:20 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:21.355454 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-f1b765a1-4371-4791-b297-38c14afef3de req-5c7bb326-b787-4a5f-997f-b0e39cd90d43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e075348c-c206-4d9a-bfdd-a62857c07dec", "name": "network-vif-deleted", "tag": "0f02d863-38e9-4d24-99ba-89d714b38cb6"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:28:21.365738 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-f1b765a1-4371-4791-b297-38c14afef3de req-5c7bb326-b787-4a5f-997f-b0e39cd90d43 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:21.366173 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-f1b765a1-4371-4791-b297-38c14afef3de req-5c7bb326-b787-4a5f-997f-b0e39cd90d43 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:21.379893 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-f1b765a1-4371-4791-b297-38c14afef3de req-5c7bb326-b787-4a5f-997f-b0e39cd90d43 service nova] Creating event network-vif-deleted:0f02d863-38e9-4d24-99ba-89d714b38cb6 for instance e075348c-c206-4d9a-bfdd-a62857c07dec on hv-cinder-84163 May 13 13:28:21.385322 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-f1b765a1-4371-4791-b297-38c14afef3de req-5c7bb326-b787-4a5f-997f-b0e39cd90d43 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033478 May 13 13:28:21.386529 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 343/695] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:28:21.535428 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d7ea2432-4af5-4e3b-bd49-bbd7c5bb791c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:21.536139 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d7ea2432-4af5-4e3b-bd49-bbd7c5bb791c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:21.544389 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d7ea2432-4af5-4e3b-bd49-bbd7c5bb791c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:21.544863 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d7ea2432-4af5-4e3b-bd49-bbd7c5bb791c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:21.545654 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d7ea2432-4af5-4e3b-bd49-bbd7c5bb791c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:21.546084 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d7ea2432-4af5-4e3b-bd49-bbd7c5bb791c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:21.614014 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d7ea2432-4af5-4e3b-bd49-bbd7c5bb791c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:21.626590 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d7ea2432-4af5-4e3b-bd49-bbd7c5bb791c tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 200 len: 1293 microversion: 2.1 time: 0.090438 May 13 13:28:21.626590 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 353/696] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:21 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:22.640467 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1001481e-4e0f-4373-b97f-b86221f377d1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:22.641207 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1001481e-4e0f-4373-b97f-b86221f377d1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: e075348c-c206-4d9a-bfdd-a62857c07dec] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:22.647672 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1001481e-4e0f-4373-b97f-b86221f377d1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:22.648048 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1001481e-4e0f-4373-b97f-b86221f377d1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:22.648968 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1001481e-4e0f-4373-b97f-b86221f377d1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:22.649359 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1001481e-4e0f-4373-b97f-b86221f377d1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:22.663687 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-1001481e-4e0f-4373-b97f-b86221f377d1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] HTTP exception thrown: Instance e075348c-c206-4d9a-bfdd-a62857c07dec could not be found. May 13 13:28:22.665367 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1001481e-4e0f-4373-b97f-b86221f377d1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Request method failure captured: May 13 13:28:22.665367 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec HTTP/1.1 May 13 13:28:22.665367 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept: application/json May 13 13:28:22.665367 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity May 13 13:28:22.665367 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Connection: close May 13 13:28:22.665367 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Length: 0 May 13 13:28:22.665367 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Type: application/json May 13 13:28:22.665367 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Host: 10.222.0.13 May 13 13:28:22.665367 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None May 13 13:28:22.665367 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 May 13 13:28:22.665367 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiflu9j1w3aWMYNeaepMtfghSN45R1rpudn7y88iUBZfUo5TNiFrmf5PObcCzu3o7oE_Enr4-R9iUAQxm1SnylSai1-YY48Gzh5RYsKm6vqseENGLkqnAve6m4Gli7NdrEPkNnXAnVdgHIyQUn7lwQz8bRkj2auUPtcvSEbefYCErLs1g May 13 13:28:22.665367 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Id: None May 13 13:28:22.665367 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Name: None May 13 13:28:22.665367 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed May 13 13:28:22.665367 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True May 13 13:28:22.665367 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default May 13 13:28:22.665367 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default May 13 13:28:22.665367 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Id: a0e165a1f0d34fca81de45a48c6cdbb9 May 13 13:28:22.665367 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2055800790 May 13 13:28:22.665367 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Role: member,reader May 13 13:28:22.665367 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Roles: member,reader May 13 13:28:22.666995 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a0e165a1f0d34fca81de45a48c6cdbb9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a0e165a1f0d34fca81de45a48c6cdbb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a0e165a1f0d34fca81de45a48c6cdbb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a0e165a1f0d34fca81de45a48c6cdbb9"}]}] May 13 13:28:22.666995 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2055800790 May 13 13:28:22.666995 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Id: a0e165a1f0d34fca81de45a48c6cdbb9 May 13 13:28:22.666995 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2055800790 May 13 13:28:22.666995 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User: tempest-ServerRescueNegativeTestJSON-2055800790-project May 13 13:28:22.666995 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default May 13 13:28:22.666995 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default May 13 13:28:22.666995 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Id: 805e8e6c39f94d3bbcf60930492e297c May 13 13:28:22.666995 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2055800790-project May 13 13:28:22.666995 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: method: > May 13 13:28:22.666995 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: exception: Instance e075348c-c206-4d9a-bfdd-a62857c07dec could not be found. May 13 13:28:22.666995 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: action_args: {'id': 'e075348c-c206-4d9a-bfdd-a62857c07dec'} May 13 13:28:22.667919 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:28:22.667919 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:28:22.667919 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:28:22.667919 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:28:22.667919 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:28:22.667919 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:28:22.667919 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:28:22.667919 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:28:22.667919 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:28:22.667919 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:28:22.667919 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e075348c-c206-4d9a-bfdd-a62857c07dec could not be found. May 13 13:28:22.667919 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:28:22.667919 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:28:22.667919 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:28:22.667919 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:28:22.667919 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:28:22.667919 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:28:22.667919 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:28:22.667919 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:28:22.667919 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:28:22.670025 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:28:22.670025 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:28:22.670025 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:28:22.670025 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:28:22.670025 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:28:22.670025 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:28:22.670025 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:28:22.670025 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e075348c-c206-4d9a-bfdd-a62857c07dec could not be found. May 13 13:28:22.670025 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:28:22.670025 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:28:22.670025 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:28:22.670025 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:28:22.670025 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:28:22.670025 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:28:22.670025 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:28:22.670025 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:28:22.670025 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e075348c-c206-4d9a-bfdd-a62857c07dec could not be found. May 13 13:28:22.670025 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:28:22.671735 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1001481e-4e0f-4373-b97f-b86221f377d1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Returning 404 to user: Instance e075348c-c206-4d9a-bfdd-a62857c07dec could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:28:22.671735 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1001481e-4e0f-4373-b97f-b86221f377d1 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec" status: 404 len: 111 microversion: 2.1 time: 0.031614 May 13 13:28:22.671735 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 344/697] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:22 2022] GET /compute/v2.1/servers/e075348c-c206-4d9a-bfdd-a62857c07dec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:28:22.676405 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d338053d-6986-483f-860f-feb3b766cf97 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:22.676891 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d338053d-6986-483f-860f-feb3b766cf97 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:22.683504 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d338053d-6986-483f-860f-feb3b766cf97 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:22.684625 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d338053d-6986-483f-860f-feb3b766cf97 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:22.685552 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d338053d-6986-483f-860f-feb3b766cf97 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:22.685826 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d338053d-6986-483f-860f-feb3b766cf97 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:22.712359 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d338053d-6986-483f-860f-feb3b766cf97 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Going to try to terminate instance {{(pid=117721) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:28:22.977782 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d338053d-6986-483f-860f-feb3b766cf97 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "DELETE /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 204 len: 0 microversion: 2.1 time: 0.304972 May 13 13:28:22.978357 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 354/698] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:28:22 2022] DELETE /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 13 13:28:22.986940 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-decba828-afa4-401c-94ed-52b34888bb3b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:22.987554 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-decba828-afa4-401c-94ed-52b34888bb3b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:22.993791 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-decba828-afa4-401c-94ed-52b34888bb3b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:22.994261 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-decba828-afa4-401c-94ed-52b34888bb3b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:22.995042 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-decba828-afa4-401c-94ed-52b34888bb3b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:22.995480 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-decba828-afa4-401c-94ed-52b34888bb3b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:23.129218 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-decba828-afa4-401c-94ed-52b34888bb3b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:23.136734 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-decba828-afa4-401c-94ed-52b34888bb3b tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.154237 May 13 13:28:23.137944 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 345/699] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:22 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:24.155472 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0f6af9e0-86b4-4691-8bb3-ad3bbf6cc3b8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:24.156156 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0f6af9e0-86b4-4691-8bb3-ad3bbf6cc3b8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:24.163627 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0f6af9e0-86b4-4691-8bb3-ad3bbf6cc3b8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:24.164096 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0f6af9e0-86b4-4691-8bb3-ad3bbf6cc3b8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:24.165217 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0f6af9e0-86b4-4691-8bb3-ad3bbf6cc3b8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:24.165842 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0f6af9e0-86b4-4691-8bb3-ad3bbf6cc3b8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:24.300267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0f6af9e0-86b4-4691-8bb3-ad3bbf6cc3b8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:24.307947 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0f6af9e0-86b4-4691-8bb3-ad3bbf6cc3b8 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.157045 May 13 13:28:24.308506 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 355/700] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:24 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:25.325633 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2ce6de97-8906-452c-94ee-093fe35df168 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:25.326276 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2ce6de97-8906-452c-94ee-093fe35df168 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:25.332848 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2ce6de97-8906-452c-94ee-093fe35df168 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:25.333303 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2ce6de97-8906-452c-94ee-093fe35df168 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:25.334096 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2ce6de97-8906-452c-94ee-093fe35df168 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:25.334550 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2ce6de97-8906-452c-94ee-093fe35df168 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:25.492093 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2ce6de97-8906-452c-94ee-093fe35df168 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:25.500029 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2ce6de97-8906-452c-94ee-093fe35df168 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.178233 May 13 13:28:25.500616 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 346/701] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:25 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:26.517537 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a675a3eb-e6e3-4447-a7d8-0015365e0420 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:26.518149 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a675a3eb-e6e3-4447-a7d8-0015365e0420 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:26.524765 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a675a3eb-e6e3-4447-a7d8-0015365e0420 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:26.525215 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a675a3eb-e6e3-4447-a7d8-0015365e0420 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:26.525995 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a675a3eb-e6e3-4447-a7d8-0015365e0420 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:26.526456 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a675a3eb-e6e3-4447-a7d8-0015365e0420 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:26.662074 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a675a3eb-e6e3-4447-a7d8-0015365e0420 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:26.670223 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a675a3eb-e6e3-4447-a7d8-0015365e0420 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1521 microversion: 2.1 time: 0.156446 May 13 13:28:26.670813 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 356/702] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:26 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:27.296270 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-83e6a95a-a76a-4ba1-9b3a-2563d620e1f0 req-cfc19658-9dfc-46c2-b469-56f2104e7bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75885842-8f4b-43a8-aa30-0da326e4f6e3", "name": "network-vif-deleted", "tag": "da8f9c78-af27-45b6-9aff-0e4aa45c7266"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:28:27.305496 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-83e6a95a-a76a-4ba1-9b3a-2563d620e1f0 req-cfc19658-9dfc-46c2-b469-56f2104e7bd4 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:27.305939 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-83e6a95a-a76a-4ba1-9b3a-2563d620e1f0 req-cfc19658-9dfc-46c2-b469-56f2104e7bd4 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:27.318020 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-83e6a95a-a76a-4ba1-9b3a-2563d620e1f0 req-cfc19658-9dfc-46c2-b469-56f2104e7bd4 service nova] Creating event network-vif-deleted:da8f9c78-af27-45b6-9aff-0e4aa45c7266 for instance 75885842-8f4b-43a8-aa30-0da326e4f6e3 on hv-cinder-84163 May 13 13:28:27.323241 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-83e6a95a-a76a-4ba1-9b3a-2563d620e1f0 req-cfc19658-9dfc-46c2-b469-56f2104e7bd4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100271 May 13 13:28:27.323840 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 347/703] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:28:27.687350 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-527bdf6a-330a-42fd-8538-ca5382b1aef2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:27.687947 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-527bdf6a-330a-42fd-8538-ca5382b1aef2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:27.695490 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-527bdf6a-330a-42fd-8538-ca5382b1aef2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:27.695932 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-527bdf6a-330a-42fd-8538-ca5382b1aef2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:27.696708 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-527bdf6a-330a-42fd-8538-ca5382b1aef2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:27.697221 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-527bdf6a-330a-42fd-8538-ca5382b1aef2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:27.738663 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-527bdf6a-330a-42fd-8538-ca5382b1aef2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:27.739124 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-527bdf6a-330a-42fd-8538-ca5382b1aef2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:27.739761 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-527bdf6a-330a-42fd-8538-ca5382b1aef2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lazy-loading 'fault' on Instance uuid 75885842-8f4b-43a8-aa30-0da326e4f6e3 {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:28:27.789428 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-527bdf6a-330a-42fd-8538-ca5382b1aef2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e8e6c39f94d3bbcf60930492e297c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e165a1f0d34fca81de45a48c6cdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:27.796825 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-527bdf6a-330a-42fd-8538-ca5382b1aef2 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 200 len: 1311 microversion: 2.1 time: 0.114386 May 13 13:28:27.797393 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 357/704] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:27 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 1311 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:28.815078 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a52d7c94-be91-48a7-ae93-de30f08f3b84 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:28.815647 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a52d7c94-be91-48a7-ae93-de30f08f3b84 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] [instance: 75885842-8f4b-43a8-aa30-0da326e4f6e3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:28.821869 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a52d7c94-be91-48a7-ae93-de30f08f3b84 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:28.822374 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a52d7c94-be91-48a7-ae93-de30f08f3b84 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:28.823100 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a52d7c94-be91-48a7-ae93-de30f08f3b84 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:28.823524 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a52d7c94-be91-48a7-ae93-de30f08f3b84 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:28.838036 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-a52d7c94-be91-48a7-ae93-de30f08f3b84 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] HTTP exception thrown: Instance 75885842-8f4b-43a8-aa30-0da326e4f6e3 could not be found. May 13 13:28:28.840026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a52d7c94-be91-48a7-ae93-de30f08f3b84 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Request method failure captured: May 13 13:28:28.840026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 HTTP/1.1 May 13 13:28:28.840026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept: application/json May 13 13:28:28.840026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity May 13 13:28:28.840026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Connection: close May 13 13:28:28.840026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Length: 0 May 13 13:28:28.840026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Type: application/json May 13 13:28:28.840026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Host: 10.222.0.13 May 13 13:28:28.840026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None May 13 13:28:28.840026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 May 13 13:28:28.840026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiflu9j1w3aWMYNeaepMtfghSN45R1rpudn7y88iUBZfUo5TNiFrmf5PObcCzu3o7oE_Enr4-R9iUAQxm1SnylSai1-YY48Gzh5RYsKm6vqseENGLkqnAve6m4Gli7NdrEPkNnXAnVdgHIyQUn7lwQz8bRkj2auUPtcvSEbefYCErLs1g May 13 13:28:28.840026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Id: None May 13 13:28:28.840026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Name: None May 13 13:28:28.840026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed May 13 13:28:28.840026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True May 13 13:28:28.840026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default May 13 13:28:28.840026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default May 13 13:28:28.840026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Id: a0e165a1f0d34fca81de45a48c6cdbb9 May 13 13:28:28.840026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2055800790 May 13 13:28:28.840026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Role: member,reader May 13 13:28:28.840026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Roles: member,reader May 13 13:28:28.842383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a0e165a1f0d34fca81de45a48c6cdbb9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a0e165a1f0d34fca81de45a48c6cdbb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a0e165a1f0d34fca81de45a48c6cdbb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a0e165a1f0d34fca81de45a48c6cdbb9"}]}] May 13 13:28:28.842383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2055800790 May 13 13:28:28.842383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Id: a0e165a1f0d34fca81de45a48c6cdbb9 May 13 13:28:28.842383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2055800790 May 13 13:28:28.842383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User: tempest-ServerRescueNegativeTestJSON-2055800790-project May 13 13:28:28.842383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default May 13 13:28:28.842383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default May 13 13:28:28.842383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Id: 805e8e6c39f94d3bbcf60930492e297c May 13 13:28:28.842383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2055800790-project May 13 13:28:28.842383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: method: > May 13 13:28:28.842383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: exception: Instance 75885842-8f4b-43a8-aa30-0da326e4f6e3 could not be found. May 13 13:28:28.842383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: action_args: {'id': '75885842-8f4b-43a8-aa30-0da326e4f6e3'} May 13 13:28:28.843226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:28:28.843226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:28:28.843226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:28:28.843226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:28:28.843226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:28:28.843226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:28:28.843226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:28:28.843226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:28:28.843226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:28:28.843226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:28:28.843226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75885842-8f4b-43a8-aa30-0da326e4f6e3 could not be found. May 13 13:28:28.843226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:28:28.843226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:28:28.843226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:28:28.843226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:28:28.843226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:28:28.843226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:28:28.843226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:28:28.843226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:28:28.843226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:28:28.844637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:28:28.844637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:28:28.844637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:28:28.844637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:28:28.844637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:28:28.844637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:28:28.844637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:28:28.844637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75885842-8f4b-43a8-aa30-0da326e4f6e3 could not be found. May 13 13:28:28.844637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:28:28.844637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:28:28.844637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:28:28.844637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:28:28.844637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:28:28.844637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:28:28.844637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:28:28.844637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:28:28.844637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75885842-8f4b-43a8-aa30-0da326e4f6e3 could not be found. May 13 13:28:28.844637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:28:28.846045 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a52d7c94-be91-48a7-ae93-de30f08f3b84 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] Returning 404 to user: Instance 75885842-8f4b-43a8-aa30-0da326e4f6e3 could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:28:28.846045 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a52d7c94-be91-48a7-ae93-de30f08f3b84 tempest-ServerRescueNegativeTestJSON-2055800790 tempest-ServerRescueNegativeTestJSON-2055800790-project] 10.222.0.13 "GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3" status: 404 len: 111 microversion: 2.1 time: 0.031884 May 13 13:28:28.846045 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 348/705] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:28:28 2022] GET /compute/v2.1/servers/75885842-8f4b-43a8-aa30-0da326e4f6e3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:28:35.256903 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-9901fe13-6ef7-465f-a62d-7925dcadf516 tempest-VolumesGetTestJSON-403932961 tempest-VolumesGetTestJSON-403932961-project] Action: 'create', calling method: .version_select at 0x7fb0841429d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1980126762", "metadata": {"Type": "work"}}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:28:36.028399 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-9901fe13-6ef7-465f-a62d-7925dcadf516 tempest-VolumesGetTestJSON-403932961 tempest-VolumesGetTestJSON-403932961-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.893100 May 13 13:28:36.029034 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 358/706] 10.222.0.13 () {60 vars in 1155 bytes} [Fri May 13 13:28:35 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 895 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 13 13:28:36.040114 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-dc28137d-32ff-4c5d-923c-53ecf579ac6d tempest-VolumesGetTestJSON-403932961 tempest-VolumesGetTestJSON-403932961-project] Calling method '.version_select at 0x7fb0842d18b0>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:36.092969 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-dc28137d-32ff-4c5d-923c-53ecf579ac6d tempest-VolumesGetTestJSON-403932961 tempest-VolumesGetTestJSON-403932961-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/f213e91f-ef7d-42f7-8c92-84b8cf11447d" status: 200 len: 353 microversion: 2.1 time: 0.056580 May 13 13:28:36.093534 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 349/707] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 13 13:28:36 2022] GET /compute/v2.1/os-volumes/f213e91f-ef7d-42f7-8c92-84b8cf11447d => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:28:37.105386 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0c1673c6-83df-4ddb-8e6e-588435f65486 tempest-VolumesGetTestJSON-403932961 tempest-VolumesGetTestJSON-403932961-project] Calling method '.version_select at 0x7fb084a3a940>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:37.157510 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0c1673c6-83df-4ddb-8e6e-588435f65486 tempest-VolumesGetTestJSON-403932961 tempest-VolumesGetTestJSON-403932961-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/f213e91f-ef7d-42f7-8c92-84b8cf11447d" status: 200 len: 354 microversion: 2.1 time: 0.056420 May 13 13:28:37.158092 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 359/708] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 13 13:28:37 2022] GET /compute/v2.1/os-volumes/f213e91f-ef7d-42f7-8c92-84b8cf11447d => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:28:37.169350 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b166f41e-1cca-4e93-95d0-b61bfedb2f24 tempest-VolumesGetTestJSON-403932961 tempest-VolumesGetTestJSON-403932961-project] Calling method '.version_select at 0x7fb084312280>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:37.219308 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b166f41e-1cca-4e93-95d0-b61bfedb2f24 tempest-VolumesGetTestJSON-403932961 tempest-VolumesGetTestJSON-403932961-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/f213e91f-ef7d-42f7-8c92-84b8cf11447d" status: 200 len: 354 microversion: 2.1 time: 0.054152 May 13 13:28:37.219859 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 350/709] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 13 13:28:37 2022] GET /compute/v2.1/os-volumes/f213e91f-ef7d-42f7-8c92-84b8cf11447d => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:28:37.235869 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0609fad0-d561-40cb-b802-3ca10d7cd09c tempest-VolumesGetTestJSON-403932961 tempest-VolumesGetTestJSON-403932961-project] Calling method '.version_select at 0x7fb084164d30>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:37.435203 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0609fad0-d561-40cb-b802-3ca10d7cd09c tempest-VolumesGetTestJSON-403932961 tempest-VolumesGetTestJSON-403932961-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/f213e91f-ef7d-42f7-8c92-84b8cf11447d" status: 202 len: 0 microversion: 2.1 time: 0.202021 May 13 13:28:37.435802 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 360/710] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 13 13:28:37 2022] DELETE /compute/v2.1/os-volumes/f213e91f-ef7d-42f7-8c92-84b8cf11447d => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:28:37.444313 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-84d12cd9-f8fe-48b6-9c72-c103a0ecac60 tempest-VolumesGetTestJSON-403932961 tempest-VolumesGetTestJSON-403932961-project] Calling method '.version_select at 0x7fb0842e4af0>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:37.492807 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-84d12cd9-f8fe-48b6-9c72-c103a0ecac60 tempest-VolumesGetTestJSON-403932961 tempest-VolumesGetTestJSON-403932961-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/f213e91f-ef7d-42f7-8c92-84b8cf11447d" status: 200 len: 353 microversion: 2.1 time: 0.052262 May 13 13:28:37.494096 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 351/711] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 13 13:28:37 2022] GET /compute/v2.1/os-volumes/f213e91f-ef7d-42f7-8c92-84b8cf11447d => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:28:38.506529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-54cd3fc2-c83c-4ff9-a428-26a5956603d8 tempest-VolumesGetTestJSON-403932961 tempest-VolumesGetTestJSON-403932961-project] Calling method '.version_select at 0x7fb08946e4c0>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:38.535131 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-54cd3fc2-c83c-4ff9-a428-26a5956603d8 tempest-VolumesGetTestJSON-403932961 tempest-VolumesGetTestJSON-403932961-project] HTTP exception thrown: Volume f213e91f-ef7d-42f7-8c92-84b8cf11447d could not be found. May 13 13:28:38.537288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-54cd3fc2-c83c-4ff9-a428-26a5956603d8 tempest-VolumesGetTestJSON-403932961 tempest-VolumesGetTestJSON-403932961-project] Request method failure captured: May 13 13:28:38.537288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/os-volumes/f213e91f-ef7d-42f7-8c92-84b8cf11447d HTTP/1.1 May 13 13:28:38.537288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:28:38.537288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:28:38.537288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:28:38.537288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:28:38.537288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:28:38.537288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:28:38.537288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:28:38.537288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:28:38.537288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABifl0DJ-9WQgTDNn5uk3RTDm0L_L8rOpXVZuAeiN2-tGsd1bP0LWyAL06VkegDwdi3Uwn3fdlzRh5FJaMetW_Qede8yav_saX7hUntcRjoGfwabDq-3E3Kedti3MZDMraLdqkID7iIysTbCBMSyuyKkLO0cZGVBHZgxaYBvDS0cvE73AM May 13 13:28:38.537288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:28:38.537288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:28:38.537288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:28:38.537288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:28:38.537288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:28:38.537288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:28:38.537288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: 68c1428f4a5a40fcaeac99a9f2b69a75 May 13 13:28:38.537288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-VolumesGetTestJSON-403932961 May 13 13:28:38.537288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:28:38.537288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:28:38.538880 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_68c1428f4a5a40fcaeac99a9f2b69a75", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68c1428f4a5a40fcaeac99a9f2b69a75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/68c1428f4a5a40fcaeac99a9f2b69a75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68c1428f4a5a40fcaeac99a9f2b69a75"}]}] May 13 13:28:38.538880 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-VolumesGetTestJSON-403932961 May 13 13:28:38.538880 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 68c1428f4a5a40fcaeac99a9f2b69a75 May 13 13:28:38.538880 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-VolumesGetTestJSON-403932961 May 13 13:28:38.538880 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-VolumesGetTestJSON-403932961-project May 13 13:28:38.538880 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:28:38.538880 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:28:38.538880 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: 108be49f28f542ef92901e54a8dc27bf May 13 13:28:38.538880 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-VolumesGetTestJSON-403932961-project May 13 13:28:38.538880 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: May 13 13:28:38.538880 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Volume f213e91f-ef7d-42f7-8c92-84b8cf11447d could not be found. May 13 13:28:38.538880 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': 'f213e91f-ef7d-42f7-8c92-84b8cf11447d'} May 13 13:28:38.538880 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:28:38.539906 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:28:38.539906 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:28:38.539906 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:28:38.539906 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 13:28:38.539906 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 13:28:38.539906 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 13:28:38.539906 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 13:28:38.539906 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:28:38.539906 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:28:38.539906 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:28:38.539906 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:28:38.539906 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:28:38.539906 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:28:38.539906 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:28:38.539906 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:28:38.539906 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f213e91f-ef7d-42f7-8c92-84b8cf11447d could not be found. (HTTP 404) (Request-ID: req-de282879-3329-483b-8d4d-aa1986af21a3) May 13 13:28:38.539906 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:28:38.539906 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:28:38.539906 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:28:38.541283 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:28:38.541283 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 13:28:38.541283 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 13:28:38.541283 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 13:28:38.541283 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 13:28:38.541283 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 13:28:38.541283 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 13:28:38.541283 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 13:28:38.541283 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 13:28:38.541283 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:28:38.541283 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:28:38.541283 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 13:28:38.541283 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 13:28:38.541283 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 13:28:38.541283 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 13:28:38.541283 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:28:38.541283 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:28:38.541283 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:28:38.541283 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:28:38.542790 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:28:38.542790 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:28:38.542790 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:28:38.542790 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:28:38.542790 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f213e91f-ef7d-42f7-8c92-84b8cf11447d could not be found. May 13 13:28:38.542790 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:28:38.542790 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:28:38.542790 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:28:38.542790 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:28:38.542790 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:28:38.542790 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:28:38.542790 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:28:38.542790 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:28:38.542790 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:28:38.542790 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:28:38.542790 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:28:38.542790 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:28:38.542790 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 13:28:38.542790 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:28:38.544136 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f213e91f-ef7d-42f7-8c92-84b8cf11447d could not be found. May 13 13:28:38.544136 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:28:38.544136 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:28:38.544136 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:28:38.544136 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:28:38.544136 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:28:38.544136 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:28:38.544136 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:28:38.544136 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:28:38.544136 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f213e91f-ef7d-42f7-8c92-84b8cf11447d could not be found. May 13 13:28:38.544136 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:28:38.544136 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-54cd3fc2-c83c-4ff9-a428-26a5956603d8 tempest-VolumesGetTestJSON-403932961 tempest-VolumesGetTestJSON-403932961-project] Returning 404 to user: Volume f213e91f-ef7d-42f7-8c92-84b8cf11447d could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:28:38.544136 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-54cd3fc2-c83c-4ff9-a428-26a5956603d8 tempest-VolumesGetTestJSON-403932961 tempest-VolumesGetTestJSON-403932961-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/f213e91f-ef7d-42f7-8c92-84b8cf11447d" status: 404 len: 109 microversion: 2.1 time: 0.036537 May 13 13:28:38.544136 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 361/712] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 13 13:28:38 2022] GET /compute/v2.1/os-volumes/f213e91f-ef7d-42f7-8c92-84b8cf11447d => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:28:39.660521 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7e48ee21-df34-44d5-a4ec-ccabd334510f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:39.661057 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7e48ee21-df34-44d5-a4ec-ccabd334510f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:39.667225 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7e48ee21-df34-44d5-a4ec-ccabd334510f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:39.667672 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7e48ee21-df34-44d5-a4ec-ccabd334510f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:39.668456 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7e48ee21-df34-44d5-a4ec-ccabd334510f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:39.668888 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7e48ee21-df34-44d5-a4ec-ccabd334510f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:39.693016 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7e48ee21-df34-44d5-a4ec-ccabd334510f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d/ips" status: 200 len: 151 microversion: 2.20 time: 0.215240 May 13 13:28:39.693557 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 352/713] 10.222.0.13 () {60 vars in 1288 bytes} [Fri May 13 13:28:39 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d/ips => generated 151 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:28:41.972990 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-789819f2-2bf1-43ad-96cc-2c11c21e539a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:28:41.973535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-789819f2-2bf1-43ad-96cc-2c11c21e539a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:41.979776 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-789819f2-2bf1-43ad-96cc-2c11c21e539a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:41.980224 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-789819f2-2bf1-43ad-96cc-2c11c21e539a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:41.981963 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-789819f2-2bf1-43ad-96cc-2c11c21e539a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:41.982430 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-789819f2-2bf1-43ad-96cc-2c11c21e539a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:42.007092 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-789819f2-2bf1-43ad-96cc-2c11c21e539a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lazy-loading 'flavor' on Instance uuid 274c20ca-135a-48d9-85e5-7c99cf77f68d {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:28:42.741470 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-789819f2-2bf1-43ad-96cc-2c11c21e539a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "POST /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d/action" status: 202 len: 0 microversion: 2.20 time: 0.773394 May 13 13:28:42.742383 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 362/714] 10.222.0.13 () {62 vars in 1318 bytes} [Fri May 13 13:28:41 2022] POST /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d/action => generated 0 bytes in 775 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 13:28:42.750910 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c97bfccf-ca52-42c9-b89e-e94c20d28157 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:42.751538 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c97bfccf-ca52-42c9-b89e-e94c20d28157 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:42.758110 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c97bfccf-ca52-42c9-b89e-e94c20d28157 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:42.758591 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c97bfccf-ca52-42c9-b89e-e94c20d28157 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:42.759369 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c97bfccf-ca52-42c9-b89e-e94c20d28157 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:42.759805 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c97bfccf-ca52-42c9-b89e-e94c20d28157 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:42.900658 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c97bfccf-ca52-42c9-b89e-e94c20d28157 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:42.908874 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c97bfccf-ca52-42c9-b89e-e94c20d28157 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:42.910403 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c97bfccf-ca52-42c9-b89e-e94c20d28157 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:42.911558 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c97bfccf-ca52-42c9-b89e-e94c20d28157 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1723 microversion: 2.20 time: 0.165148 May 13 13:28:42.912109 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 353/715] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:28:42 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:43.933709 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7597eb1c-1aa9-45f1-9b72-21bbcba41838 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:43.934435 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7597eb1c-1aa9-45f1-9b72-21bbcba41838 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:43.941028 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7597eb1c-1aa9-45f1-9b72-21bbcba41838 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:43.941469 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7597eb1c-1aa9-45f1-9b72-21bbcba41838 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:43.942267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7597eb1c-1aa9-45f1-9b72-21bbcba41838 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:43.942698 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7597eb1c-1aa9-45f1-9b72-21bbcba41838 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:44.078619 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7597eb1c-1aa9-45f1-9b72-21bbcba41838 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:44.087158 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7597eb1c-1aa9-45f1-9b72-21bbcba41838 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:44.088634 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7597eb1c-1aa9-45f1-9b72-21bbcba41838 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:44.090764 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7597eb1c-1aa9-45f1-9b72-21bbcba41838 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1723 microversion: 2.20 time: 0.161077 May 13 13:28:44.090764 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 363/716] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:28:43 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:45.109412 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e172d79c-65c0-4ade-a5e7-adc552ade14b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:45.110004 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e172d79c-65c0-4ade-a5e7-adc552ade14b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:45.116558 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e172d79c-65c0-4ade-a5e7-adc552ade14b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:45.117002 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e172d79c-65c0-4ade-a5e7-adc552ade14b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:45.117782 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e172d79c-65c0-4ade-a5e7-adc552ade14b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:45.118241 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e172d79c-65c0-4ade-a5e7-adc552ade14b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:45.262874 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e172d79c-65c0-4ade-a5e7-adc552ade14b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:45.271939 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e172d79c-65c0-4ade-a5e7-adc552ade14b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:45.273409 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e172d79c-65c0-4ade-a5e7-adc552ade14b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:45.274858 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e172d79c-65c0-4ade-a5e7-adc552ade14b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1723 microversion: 2.20 time: 0.169506 May 13 13:28:45.275419 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 354/717] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:28:45 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:46.293153 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-be9cd037-dcef-4817-b194-07ef7e6f3c7d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:46.293757 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-be9cd037-dcef-4817-b194-07ef7e6f3c7d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:46.299865 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-be9cd037-dcef-4817-b194-07ef7e6f3c7d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:46.300305 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-be9cd037-dcef-4817-b194-07ef7e6f3c7d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:46.301075 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-be9cd037-dcef-4817-b194-07ef7e6f3c7d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:46.301504 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-be9cd037-dcef-4817-b194-07ef7e6f3c7d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:46.433453 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-be9cd037-dcef-4817-b194-07ef7e6f3c7d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:46.441776 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-be9cd037-dcef-4817-b194-07ef7e6f3c7d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:46.443291 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-be9cd037-dcef-4817-b194-07ef7e6f3c7d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:46.444434 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-be9cd037-dcef-4817-b194-07ef7e6f3c7d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1723 microversion: 2.20 time: 0.155384 May 13 13:28:46.444990 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 364/718] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:28:46 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:47.462811 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3b118ded-8015-4b1d-bf7b-b57168cae86d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:47.463439 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3b118ded-8015-4b1d-bf7b-b57168cae86d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:47.471778 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3b118ded-8015-4b1d-bf7b-b57168cae86d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:47.472230 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3b118ded-8015-4b1d-bf7b-b57168cae86d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:47.473008 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3b118ded-8015-4b1d-bf7b-b57168cae86d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:47.473445 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3b118ded-8015-4b1d-bf7b-b57168cae86d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:47.603895 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3b118ded-8015-4b1d-bf7b-b57168cae86d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:47.612120 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3b118ded-8015-4b1d-bf7b-b57168cae86d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:47.613604 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3b118ded-8015-4b1d-bf7b-b57168cae86d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:47.614791 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3b118ded-8015-4b1d-bf7b-b57168cae86d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1723 microversion: 2.20 time: 0.155845 May 13 13:28:47.615344 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 355/719] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:28:47 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:48.091756 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-88d0d26c-9ae1-4786-b8cd-eb82a233d0fc tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:48.092306 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-88d0d26c-9ae1-4786-b8cd-eb82a233d0fc tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:48.098548 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-88d0d26c-9ae1-4786-b8cd-eb82a233d0fc tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:48.098989 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-88d0d26c-9ae1-4786-b8cd-eb82a233d0fc tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:48.099757 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-88d0d26c-9ae1-4786-b8cd-eb82a233d0fc tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:48.100182 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-88d0d26c-9ae1-4786-b8cd-eb82a233d0fc tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:48.124545 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-88d0d26c-9ae1-4786-b8cd-eb82a233d0fc tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819/ips" status: 200 len: 149 microversion: 2.1 time: 0.037564 May 13 13:28:48.125112 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 365/720] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 13 13:28:48 2022] GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:28:48.632795 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0dbdcd04-de2d-4fcb-b323-18ecee4a469d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:48.633381 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0dbdcd04-de2d-4fcb-b323-18ecee4a469d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:48.640343 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0dbdcd04-de2d-4fcb-b323-18ecee4a469d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:48.640794 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0dbdcd04-de2d-4fcb-b323-18ecee4a469d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:48.641562 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0dbdcd04-de2d-4fcb-b323-18ecee4a469d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:48.641993 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0dbdcd04-de2d-4fcb-b323-18ecee4a469d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:48.785183 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0dbdcd04-de2d-4fcb-b323-18ecee4a469d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:48.794643 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0dbdcd04-de2d-4fcb-b323-18ecee4a469d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:48.797216 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0dbdcd04-de2d-4fcb-b323-18ecee4a469d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:48.798437 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0dbdcd04-de2d-4fcb-b323-18ecee4a469d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1723 microversion: 2.20 time: 0.169763 May 13 13:28:48.799322 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 356/721] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:28:48 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:49.779011 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e419e4b1-ff61-4ed6-82e0-b08bfa36e0a9 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "158b129b-5f4f-4e27-b3d0-c6b27bf0928e"}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:28:49.780165 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e419e4b1-ff61-4ed6-82e0-b08bfa36e0a9 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:49.786682 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e419e4b1-ff61-4ed6-82e0-b08bfa36e0a9 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:49.790558 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e419e4b1-ff61-4ed6-82e0-b08bfa36e0a9 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:49.790558 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e419e4b1-ff61-4ed6-82e0-b08bfa36e0a9 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:49.790558 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e419e4b1-ff61-4ed6-82e0-b08bfa36e0a9 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:49.816482 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3b5b72b3-1382-4898-8262-8bb9e249906c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:49.817137 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3b5b72b3-1382-4898-8262-8bb9e249906c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:49.825610 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3b5b72b3-1382-4898-8262-8bb9e249906c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:49.826025 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3b5b72b3-1382-4898-8262-8bb9e249906c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:49.826796 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3b5b72b3-1382-4898-8262-8bb9e249906c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:49.827226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3b5b72b3-1382-4898-8262-8bb9e249906c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:49.969545 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3b5b72b3-1382-4898-8262-8bb9e249906c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:49.978552 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3b5b72b3-1382-4898-8262-8bb9e249906c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:49.981429 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3b5b72b3-1382-4898-8262-8bb9e249906c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:49.982324 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3b5b72b3-1382-4898-8262-8bb9e249906c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1723 microversion: 2.20 time: 0.169710 May 13 13:28:49.982977 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 357/722] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:28:49 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:50.638695 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e419e4b1-ff61-4ed6-82e0-b08bfa36e0a9 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "POST /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.864645 May 13 13:28:50.639364 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 366/723] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 13 13:28:49 2022] POST /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819/os-volume_attachments => generated 194 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:28:51.001477 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c1c9d6bc-31b0-44a8-847c-ec063bf2d413 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:51.002091 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c1c9d6bc-31b0-44a8-847c-ec063bf2d413 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:51.008470 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c1c9d6bc-31b0-44a8-847c-ec063bf2d413 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:51.008915 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c1c9d6bc-31b0-44a8-847c-ec063bf2d413 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:51.009741 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c1c9d6bc-31b0-44a8-847c-ec063bf2d413 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:51.010168 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c1c9d6bc-31b0-44a8-847c-ec063bf2d413 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:51.146776 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c1c9d6bc-31b0-44a8-847c-ec063bf2d413 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:51.154941 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c1c9d6bc-31b0-44a8-847c-ec063bf2d413 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:51.156437 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c1c9d6bc-31b0-44a8-847c-ec063bf2d413 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:51.157583 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c1c9d6bc-31b0-44a8-847c-ec063bf2d413 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1723 microversion: 2.20 time: 0.160137 May 13 13:28:51.158142 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 358/724] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:28:50 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:52.177832 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-782dc82f-4cf2-4c11-99e3-e17768e2b6c0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:52.178542 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-782dc82f-4cf2-4c11-99e3-e17768e2b6c0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:52.185778 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-782dc82f-4cf2-4c11-99e3-e17768e2b6c0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:52.186296 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-782dc82f-4cf2-4c11-99e3-e17768e2b6c0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:52.187071 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-782dc82f-4cf2-4c11-99e3-e17768e2b6c0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:52.187522 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-782dc82f-4cf2-4c11-99e3-e17768e2b6c0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:52.320597 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-782dc82f-4cf2-4c11-99e3-e17768e2b6c0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:52.329465 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-782dc82f-4cf2-4c11-99e3-e17768e2b6c0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:52.331007 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-782dc82f-4cf2-4c11-99e3-e17768e2b6c0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:52.332188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-782dc82f-4cf2-4c11-99e3-e17768e2b6c0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1723 microversion: 2.20 time: 0.159109 May 13 13:28:52.332748 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 367/725] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:28:52 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:53.352152 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-19f6d76c-ded3-4682-bcfe-78f64203c1a2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:53.352859 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-19f6d76c-ded3-4682-bcfe-78f64203c1a2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:53.360132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-19f6d76c-ded3-4682-bcfe-78f64203c1a2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:53.360708 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-19f6d76c-ded3-4682-bcfe-78f64203c1a2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:53.361434 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-19f6d76c-ded3-4682-bcfe-78f64203c1a2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:53.361865 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-19f6d76c-ded3-4682-bcfe-78f64203c1a2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:53.493637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-19f6d76c-ded3-4682-bcfe-78f64203c1a2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:53.503952 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-19f6d76c-ded3-4682-bcfe-78f64203c1a2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:53.505444 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-19f6d76c-ded3-4682-bcfe-78f64203c1a2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:53.506613 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-19f6d76c-ded3-4682-bcfe-78f64203c1a2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1723 microversion: 2.20 time: 0.158748 May 13 13:28:53.511402 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 359/726] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:28:53 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:54.525584 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-81d03da3-3da3-427c-ad9f-0d4b9f7d9034 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:54.526377 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-81d03da3-3da3-427c-ad9f-0d4b9f7d9034 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:54.532630 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-81d03da3-3da3-427c-ad9f-0d4b9f7d9034 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:54.533068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-81d03da3-3da3-427c-ad9f-0d4b9f7d9034 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:54.533830 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-81d03da3-3da3-427c-ad9f-0d4b9f7d9034 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:54.534284 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-81d03da3-3da3-427c-ad9f-0d4b9f7d9034 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:54.670001 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-81d03da3-3da3-427c-ad9f-0d4b9f7d9034 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:54.678597 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-81d03da3-3da3-427c-ad9f-0d4b9f7d9034 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:54.680112 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-81d03da3-3da3-427c-ad9f-0d4b9f7d9034 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:54.681252 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-81d03da3-3da3-427c-ad9f-0d4b9f7d9034 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1723 microversion: 2.20 time: 0.159550 May 13 13:28:54.681845 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 368/727] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:28:54 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:55.700245 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b67715cb-583b-47e3-af72-4e075a923ca4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:55.700890 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b67715cb-583b-47e3-af72-4e075a923ca4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:55.707489 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b67715cb-583b-47e3-af72-4e075a923ca4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:55.707937 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b67715cb-583b-47e3-af72-4e075a923ca4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:55.708724 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b67715cb-583b-47e3-af72-4e075a923ca4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:55.709264 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b67715cb-583b-47e3-af72-4e075a923ca4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:55.844340 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b67715cb-583b-47e3-af72-4e075a923ca4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:55.855862 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b67715cb-583b-47e3-af72-4e075a923ca4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:55.855862 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b67715cb-583b-47e3-af72-4e075a923ca4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:55.856655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b67715cb-583b-47e3-af72-4e075a923ca4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1723 microversion: 2.20 time: 0.160841 May 13 13:28:55.857229 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 360/728] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:28:55 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:56.876831 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-83cdbcf7-9df2-42f2-8b95-f363f96a29a8 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:56.877447 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-83cdbcf7-9df2-42f2-8b95-f363f96a29a8 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:56.885199 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-83cdbcf7-9df2-42f2-8b95-f363f96a29a8 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:56.885646 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-83cdbcf7-9df2-42f2-8b95-f363f96a29a8 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:56.886456 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-83cdbcf7-9df2-42f2-8b95-f363f96a29a8 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:56.887570 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-83cdbcf7-9df2-42f2-8b95-f363f96a29a8 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:57.033269 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-83cdbcf7-9df2-42f2-8b95-f363f96a29a8 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:57.041454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-83cdbcf7-9df2-42f2-8b95-f363f96a29a8 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:57.044336 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-83cdbcf7-9df2-42f2-8b95-f363f96a29a8 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:57.045502 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-83cdbcf7-9df2-42f2-8b95-f363f96a29a8 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1723 microversion: 2.20 time: 0.172638 May 13 13:28:57.046068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 369/729] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:28:56 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:58.067032 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-91fc7a01-643b-4248-b688-34ae7703e629 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:58.068198 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-91fc7a01-643b-4248-b688-34ae7703e629 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:58.076642 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-91fc7a01-643b-4248-b688-34ae7703e629 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:58.077078 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-91fc7a01-643b-4248-b688-34ae7703e629 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:58.077884 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-91fc7a01-643b-4248-b688-34ae7703e629 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:58.078339 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-91fc7a01-643b-4248-b688-34ae7703e629 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:58.159469 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cef122a3-fa0a-4e70-91a8-8fab4d2f9e49 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "158b129b-5f4f-4e27-b3d0-c6b27bf0928e"}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:28:58.160510 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-cef122a3-fa0a-4e70-91a8-8fab4d2f9e49 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:58.167089 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cef122a3-fa0a-4e70-91a8-8fab4d2f9e49 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:58.167527 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cef122a3-fa0a-4e70-91a8-8fab4d2f9e49 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:58.168964 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cef122a3-fa0a-4e70-91a8-8fab4d2f9e49 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:58.169389 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cef122a3-fa0a-4e70-91a8-8fab4d2f9e49 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:58.219559 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-91fc7a01-643b-4248-b688-34ae7703e629 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:58.227619 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-91fc7a01-643b-4248-b688-34ae7703e629 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:58.229117 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-91fc7a01-643b-4248-b688-34ae7703e629 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:58.231016 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-91fc7a01-643b-4248-b688-34ae7703e629 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1723 microversion: 2.20 time: 0.169913 May 13 13:28:58.231881 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 361/730] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:28:58 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:58.257380 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-cef122a3-fa0a-4e70-91a8-8fab4d2f9e49 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] HTTP exception thrown: Invalid volume: volume 158b129b-5f4f-4e27-b3d0-c6b27bf0928e is already attached to instances: f7d1447f-444f-4e0c-a20d-9350788fd819 May 13 13:28:58.259179 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cef122a3-fa0a-4e70-91a8-8fab4d2f9e49 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Request method failure captured: May 13 13:28:58.259179 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: POST /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819/os-volume_attachments HTTP/1.1 May 13 13:28:58.259179 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:28:58.259179 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:28:58.259179 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:28:58.259179 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 74 May 13 13:28:58.259179 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:28:58.259179 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:28:58.259179 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:28:58.259179 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:28:58.259179 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiflwBMboKTbh58LY9MV46SCnkvCoDA8Lz7MKk4gwRCoxQPs10Nennf59WSFpA35k2_OuVUqc3Ildqh9KXOiYz1kwf-o_5U0rFqJBoVhvd5RC1KNKMiAiCN3X4-U5A2Z5o8ov4tv4DHgjoV-mWgbm8gyYcnkReiO1lr3jQvWIeRv7-V3g May 13 13:28:58.259179 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:28:58.259179 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:28:58.259179 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:28:58.259179 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:28:58.259179 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:28:58.259179 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:28:58.259179 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:28:58.259179 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:28:58.259179 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:28:58.259179 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:28:58.260731 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2c900748e271404bb3cb11fb2308e784", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}] May 13 13:28:58.260731 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:28:58.260731 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:28:58.260731 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:28:58.260731 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:28:58.260731 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:28:58.260731 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:28:58.260731 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: e25df7c837584b19afe274f6edfb8efd May 13 13:28:58.260731 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:28:58.260731 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: May 13 13:28:58.260731 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {"volumeAttachment": {"volumeId": "158b129b-5f4f-4e27-b3d0-c6b27bf0928e"}} May 13 13:28:58.260731 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: > May 13 13:28:58.265097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Invalid volume: volume 158b129b-5f4f-4e27-b3d0-c6b27bf0928e is already attached to instances: f7d1447f-444f-4e0c-a20d-9350788fd819 May 13 13:28:58.265097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'server_id': 'f7d1447f-444f-4e0c-a20d-9350788fd819', 'body': {'volumeAttachment': {'volumeId': '158b129b-5f4f-4e27-b3d0-c6b27bf0928e'}}} May 13 13:28:58.265097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:28:58.265097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:28:58.265097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 13 13:28:58.265097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 13 13:28:58.265097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 13:28:58.265097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 13:28:58.265097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 13 13:28:58.265097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 13 13:28:58.265097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 13 13:28:58.265097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 13 13:28:58.265097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 13 13:28:58.265097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 13 13:28:58.265097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 158b129b-5f4f-4e27-b3d0-c6b27bf0928e is already attached to instances: f7d1447f-444f-4e0c-a20d-9350788fd819 May 13 13:28:58.265097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:28:58.265097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:28:58.265097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:28:58.265097 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:28:58.266509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:28:58.266509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:28:58.266509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:28:58.266509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:28:58.266509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:28:58.266509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:28:58.266509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 13:28:58.266509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:28:58.266509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 13:28:58.266509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:28:58.266509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 13:28:58.266509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:28:58.266509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 13 13:28:58.266509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 13 13:28:58.266509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 158b129b-5f4f-4e27-b3d0-c6b27bf0928e is already attached to instances: f7d1447f-444f-4e0c-a20d-9350788fd819 May 13 13:28:58.266509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:28:58.266509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:28:58.266509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:28:58.266509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:28:58.266509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:28:58.267932 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:28:58.267932 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:28:58.267932 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:28:58.267932 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 158b129b-5f4f-4e27-b3d0-c6b27bf0928e is already attached to instances: f7d1447f-444f-4e0c-a20d-9350788fd819 May 13 13:28:58.267932 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:28:58.267932 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cef122a3-fa0a-4e70-91a8-8fab4d2f9e49 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Returning 400 to user: Invalid volume: volume 158b129b-5f4f-4e27-b3d0-c6b27bf0928e is already attached to instances: f7d1447f-444f-4e0c-a20d-9350788fd819 {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:28:58.267932 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-cef122a3-fa0a-4e70-91a8-8fab4d2f9e49 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "POST /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105213 May 13 13:28:58.267932 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 370/731] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 13 13:28:58 2022] POST /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 13 13:28:58.325331 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-07406c45-9434-409a-8e42-9b9a03cb5b80 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:58.325820 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-07406c45-9434-409a-8e42-9b9a03cb5b80 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:58.331985 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-07406c45-9434-409a-8e42-9b9a03cb5b80 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:58.332433 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-07406c45-9434-409a-8e42-9b9a03cb5b80 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:58.333226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-07406c45-9434-409a-8e42-9b9a03cb5b80 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:58.333659 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-07406c45-9434-409a-8e42-9b9a03cb5b80 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:58.364086 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-94d3893e-61fd-4b0d-9c66-c1d2b16d5f2b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:58.364674 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-94d3893e-61fd-4b0d-9c66-c1d2b16d5f2b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:58.372357 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-94d3893e-61fd-4b0d-9c66-c1d2b16d5f2b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:58.372939 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-94d3893e-61fd-4b0d-9c66-c1d2b16d5f2b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:58.374533 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-94d3893e-61fd-4b0d-9c66-c1d2b16d5f2b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:58.374533 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-94d3893e-61fd-4b0d-9c66-c1d2b16d5f2b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:58.401085 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-94d3893e-61fd-4b0d-9c66-c1d2b16d5f2b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/ips" status: 200 len: 145 microversion: 2.1 time: 0.040740 May 13 13:28:58.401670 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 371/732] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 13 13:28:58 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:28:58.419562 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-07406c45-9434-409a-8e42-9b9a03cb5b80 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lazy-loading 'services' on Instance uuid f7d1447f-444f-4e0c-a20d-9350788fd819 {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:28:58.679632 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-07406c45-9434-409a-8e42-9b9a03cb5b80 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819/os-volume_attachments/158b129b-5f4f-4e27-b3d0-c6b27bf0928e" status: 202 len: 0 microversion: 2.1 time: 0.358320 May 13 13:28:58.684221 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 362/733] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 13 13:28:58 2022] DELETE /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819/os-volume_attachments/158b129b-5f4f-4e27-b3d0-c6b27bf0928e => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 13:28:58.690314 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-da270f06-2e98-4b3f-a8bb-3609d2ad4174 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:58.691246 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-da270f06-2e98-4b3f-a8bb-3609d2ad4174 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:58.697679 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-da270f06-2e98-4b3f-a8bb-3609d2ad4174 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:58.698131 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-da270f06-2e98-4b3f-a8bb-3609d2ad4174 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:58.698941 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-da270f06-2e98-4b3f-a8bb-3609d2ad4174 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:58.700109 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-da270f06-2e98-4b3f-a8bb-3609d2ad4174 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:58.731640 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-da270f06-2e98-4b3f-a8bb-3609d2ad4174 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046544 May 13 13:28:58.732212 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 372/734] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 13 13:28:58 2022] GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:28:59.250235 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-95be7399-bffa-4eed-a65a-b61752d3868a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:59.250998 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-95be7399-bffa-4eed-a65a-b61752d3868a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:59.257855 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-95be7399-bffa-4eed-a65a-b61752d3868a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:59.258398 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-95be7399-bffa-4eed-a65a-b61752d3868a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:59.259144 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-95be7399-bffa-4eed-a65a-b61752d3868a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:59.259593 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-95be7399-bffa-4eed-a65a-b61752d3868a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:59.401448 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-95be7399-bffa-4eed-a65a-b61752d3868a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:59.409871 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-95be7399-bffa-4eed-a65a-b61752d3868a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:59.411551 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-95be7399-bffa-4eed-a65a-b61752d3868a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:59.412722 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-95be7399-bffa-4eed-a65a-b61752d3868a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1723 microversion: 2.20 time: 0.167191 May 13 13:28:59.413296 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 363/735] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:28:59 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:59.743815 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-82accde6-b650-4cbe-a82e-1683a366287f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:59.744748 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-82accde6-b650-4cbe-a82e-1683a366287f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:59.752204 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-82accde6-b650-4cbe-a82e-1683a366287f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:59.758278 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-82accde6-b650-4cbe-a82e-1683a366287f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:59.758278 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-82accde6-b650-4cbe-a82e-1683a366287f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:59.758278 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-82accde6-b650-4cbe-a82e-1683a366287f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:59.784848 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-82accde6-b650-4cbe-a82e-1683a366287f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044907 May 13 13:28:59.791159 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 373/736] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 13 13:28:59 2022] GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:00.111925 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-862dc683-d17b-4851-b30f-f46ba2523d3c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1db76e0-c82c-42e2-ab47-b870c7f61eae"}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:00.113032 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-862dc683-d17b-4851-b30f-f46ba2523d3c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:00.119093 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-862dc683-d17b-4851-b30f-f46ba2523d3c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:00.123841 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-862dc683-d17b-4851-b30f-f46ba2523d3c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:00.123841 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-862dc683-d17b-4851-b30f-f46ba2523d3c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:00.123841 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-862dc683-d17b-4851-b30f-f46ba2523d3c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:00.431056 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-071d10f4-c373-42bb-b647-ffbf39bc9a33 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:00.431703 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-071d10f4-c373-42bb-b647-ffbf39bc9a33 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:00.438060 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-071d10f4-c373-42bb-b647-ffbf39bc9a33 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:00.438551 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-071d10f4-c373-42bb-b647-ffbf39bc9a33 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:00.439337 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-071d10f4-c373-42bb-b647-ffbf39bc9a33 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:00.439775 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-071d10f4-c373-42bb-b647-ffbf39bc9a33 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:00.580959 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-071d10f4-c373-42bb-b647-ffbf39bc9a33 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:00.592734 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-071d10f4-c373-42bb-b647-ffbf39bc9a33 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:00.594322 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-071d10f4-c373-42bb-b647-ffbf39bc9a33 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:00.595822 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-071d10f4-c373-42bb-b647-ffbf39bc9a33 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1723 microversion: 2.20 time: 0.168359 May 13 13:29:00.596336 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 374/737] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:00 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:00.802956 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c018e87d-21a6-4d88-9290-3f362299271b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:00.803947 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c018e87d-21a6-4d88-9290-3f362299271b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:00.811101 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c018e87d-21a6-4d88-9290-3f362299271b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:00.811547 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c018e87d-21a6-4d88-9290-3f362299271b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:00.812325 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c018e87d-21a6-4d88-9290-3f362299271b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:00.812754 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c018e87d-21a6-4d88-9290-3f362299271b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:00.847475 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c018e87d-21a6-4d88-9290-3f362299271b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049246 May 13 13:29:00.848054 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 375/738] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 13 13:29:00 2022] GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 13 13:29:00.907760 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e47f841e-711b-4c9b-b0bb-6abe87b7845d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:00.908436 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e47f841e-711b-4c9b-b0bb-6abe87b7845d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:00.914857 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e47f841e-711b-4c9b-b0bb-6abe87b7845d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:00.915305 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e47f841e-711b-4c9b-b0bb-6abe87b7845d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:00.916110 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e47f841e-711b-4c9b-b0bb-6abe87b7845d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:00.916541 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e47f841e-711b-4c9b-b0bb-6abe87b7845d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:00.942927 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e47f841e-711b-4c9b-b0bb-6abe87b7845d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Going to try to terminate instance {{(pid=117721) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:29:01.091594 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-862dc683-d17b-4851-b30f-f46ba2523d3c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "POST /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.983089 May 13 13:29:01.097200 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 364/739] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 13 13:29:00 2022] POST /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/os-volume_attachments => generated 194 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:01.331191 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e47f841e-711b-4c9b-b0bb-6abe87b7845d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819" status: 204 len: 0 microversion: 2.1 time: 0.427183 May 13 13:29:01.332111 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 376/740] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:29:00 2022] DELETE /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 13 13:29:01.342032 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c6950717-2bb5-4f49-bf06-5a5285556691 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:01.342979 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c6950717-2bb5-4f49-bf06-5a5285556691 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:01.350769 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c6950717-2bb5-4f49-bf06-5a5285556691 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:01.351213 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c6950717-2bb5-4f49-bf06-5a5285556691 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:01.351996 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c6950717-2bb5-4f49-bf06-5a5285556691 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:01.352427 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c6950717-2bb5-4f49-bf06-5a5285556691 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:01.516608 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c6950717-2bb5-4f49-bf06-5a5285556691 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:01.524232 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c6950717-2bb5-4f49-bf06-5a5285556691 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819" status: 200 len: 1682 microversion: 2.1 time: 0.187868 May 13 13:29:01.528131 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 365/741] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:29:01 2022] GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819 => generated 1682 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:01.614022 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-87597509-ec14-4568-aad5-f26122a301a4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:01.614769 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-87597509-ec14-4568-aad5-f26122a301a4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:01.620784 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-87597509-ec14-4568-aad5-f26122a301a4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:01.621210 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-87597509-ec14-4568-aad5-f26122a301a4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:01.622122 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-87597509-ec14-4568-aad5-f26122a301a4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:01.622576 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-87597509-ec14-4568-aad5-f26122a301a4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:01.760228 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-87597509-ec14-4568-aad5-f26122a301a4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:01.769016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-87597509-ec14-4568-aad5-f26122a301a4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:01.770559 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-87597509-ec14-4568-aad5-f26122a301a4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:01.771744 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-87597509-ec14-4568-aad5-f26122a301a4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1723 microversion: 2.20 time: 0.162152 May 13 13:29:01.772301 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 377/742] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:01 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:02.543366 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-eda52c9b-4383-4af4-8261-5e79eecc9a63 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:02.543994 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-eda52c9b-4383-4af4-8261-5e79eecc9a63 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:02.550781 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-eda52c9b-4383-4af4-8261-5e79eecc9a63 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:02.551236 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-eda52c9b-4383-4af4-8261-5e79eecc9a63 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:02.552014 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-eda52c9b-4383-4af4-8261-5e79eecc9a63 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:02.552522 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-eda52c9b-4383-4af4-8261-5e79eecc9a63 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:02.685506 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-eda52c9b-4383-4af4-8261-5e79eecc9a63 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:02.693095 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-eda52c9b-4383-4af4-8261-5e79eecc9a63 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819" status: 200 len: 1682 microversion: 2.1 time: 0.154252 May 13 13:29:02.697870 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 366/743] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:29:02 2022] GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:02.792030 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-04a00ba4-5eeb-43be-8246-bb623e030c98 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:02.793148 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-04a00ba4-5eeb-43be-8246-bb623e030c98 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:02.799681 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-04a00ba4-5eeb-43be-8246-bb623e030c98 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:02.800188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-04a00ba4-5eeb-43be-8246-bb623e030c98 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:02.800956 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-04a00ba4-5eeb-43be-8246-bb623e030c98 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:02.801530 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-04a00ba4-5eeb-43be-8246-bb623e030c98 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:02.942777 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-04a00ba4-5eeb-43be-8246-bb623e030c98 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:02.950915 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-04a00ba4-5eeb-43be-8246-bb623e030c98 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:02.952411 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-04a00ba4-5eeb-43be-8246-bb623e030c98 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:02.953549 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-04a00ba4-5eeb-43be-8246-bb623e030c98 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1723 microversion: 2.20 time: 0.165703 May 13 13:29:02.954110 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 378/744] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:02 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:03.709255 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b36930d0-99f0-4d76-9cbb-5875dfb3b752 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:03.709841 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b36930d0-99f0-4d76-9cbb-5875dfb3b752 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:03.716916 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b36930d0-99f0-4d76-9cbb-5875dfb3b752 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:03.717478 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b36930d0-99f0-4d76-9cbb-5875dfb3b752 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:03.718335 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b36930d0-99f0-4d76-9cbb-5875dfb3b752 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:03.718768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b36930d0-99f0-4d76-9cbb-5875dfb3b752 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:03.862431 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b36930d0-99f0-4d76-9cbb-5875dfb3b752 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:03.870329 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b36930d0-99f0-4d76-9cbb-5875dfb3b752 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819" status: 200 len: 1682 microversion: 2.1 time: 0.164758 May 13 13:29:03.871498 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 367/745] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:29:03 2022] GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:03.974546 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f0422964-73b7-4db5-bbe5-86ac9adb2fb6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:03.975120 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f0422964-73b7-4db5-bbe5-86ac9adb2fb6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:03.984082 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f0422964-73b7-4db5-bbe5-86ac9adb2fb6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:03.988071 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f0422964-73b7-4db5-bbe5-86ac9adb2fb6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:03.988071 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f0422964-73b7-4db5-bbe5-86ac9adb2fb6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:03.988071 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f0422964-73b7-4db5-bbe5-86ac9adb2fb6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:04.131833 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f0422964-73b7-4db5-bbe5-86ac9adb2fb6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:04.140611 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f0422964-73b7-4db5-bbe5-86ac9adb2fb6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:04.142114 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f0422964-73b7-4db5-bbe5-86ac9adb2fb6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:04.143358 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f0422964-73b7-4db5-bbe5-86ac9adb2fb6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1744 microversion: 2.20 time: 0.174436 May 13 13:29:04.147095 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 379/746] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:03 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1744 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:04.353179 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-cea7b9ae-55c1-4cfb-afdc-6ded15f6fac2 req-b965c6af-75e7-4664-b21b-f45e36bb4ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d1447f-444f-4e0c-a20d-9350788fd819", "name": "network-vif-deleted", "tag": "26a3043c-a71b-4f33-b912-ba88ebf29476"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:04.363432 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-cea7b9ae-55c1-4cfb-afdc-6ded15f6fac2 req-b965c6af-75e7-4664-b21b-f45e36bb4ad7 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:04.365767 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-cea7b9ae-55c1-4cfb-afdc-6ded15f6fac2 req-b965c6af-75e7-4664-b21b-f45e36bb4ad7 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:04.377030 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-cea7b9ae-55c1-4cfb-afdc-6ded15f6fac2 req-b965c6af-75e7-4664-b21b-f45e36bb4ad7 service nova] Creating event network-vif-deleted:26a3043c-a71b-4f33-b912-ba88ebf29476 for instance f7d1447f-444f-4e0c-a20d-9350788fd819 on hv-cinder-84163 May 13 13:29:04.382907 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-cea7b9ae-55c1-4cfb-afdc-6ded15f6fac2 req-b965c6af-75e7-4664-b21b-f45e36bb4ad7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036312 May 13 13:29:04.383542 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 368/747] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:04.894163 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e0d88f49-165b-4f73-8c20-d5dbfae003db tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:04.894163 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e0d88f49-165b-4f73-8c20-d5dbfae003db tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:04.904529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e0d88f49-165b-4f73-8c20-d5dbfae003db tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:04.905234 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e0d88f49-165b-4f73-8c20-d5dbfae003db tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:04.906026 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e0d88f49-165b-4f73-8c20-d5dbfae003db tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:04.906695 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e0d88f49-165b-4f73-8c20-d5dbfae003db tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:04.941072 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e0d88f49-165b-4f73-8c20-d5dbfae003db tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:04.941949 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e0d88f49-165b-4f73-8c20-d5dbfae003db tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:04.941949 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-e0d88f49-165b-4f73-8c20-d5dbfae003db tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lazy-loading 'fault' on Instance uuid f7d1447f-444f-4e0c-a20d-9350788fd819 {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:29:04.993676 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e0d88f49-165b-4f73-8c20-d5dbfae003db tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:05.002363 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e0d88f49-165b-4f73-8c20-d5dbfae003db tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819" status: 200 len: 1332 microversion: 2.1 time: 0.117038 May 13 13:29:05.003133 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 380/748] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:29:04 2022] GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819 => generated 1332 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:05.168275 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7ae0f016-9346-48f1-8835-b6b7c635aa61 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:05.169321 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7ae0f016-9346-48f1-8835-b6b7c635aa61 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:05.182330 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7ae0f016-9346-48f1-8835-b6b7c635aa61 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:05.183105 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7ae0f016-9346-48f1-8835-b6b7c635aa61 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:05.184891 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7ae0f016-9346-48f1-8835-b6b7c635aa61 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:05.185357 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7ae0f016-9346-48f1-8835-b6b7c635aa61 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:05.353021 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7ae0f016-9346-48f1-8835-b6b7c635aa61 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:05.367692 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7ae0f016-9346-48f1-8835-b6b7c635aa61 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:05.369206 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7ae0f016-9346-48f1-8835-b6b7c635aa61 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:05.400130 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7ae0f016-9346-48f1-8835-b6b7c635aa61 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1744 microversion: 2.20 time: 0.239282 May 13 13:29:05.401227 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 369/749] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:05 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1744 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:06.019873 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-fb9d564f-5210-412e-b95f-1235c46ed46e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:06.020416 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-fb9d564f-5210-412e-b95f-1235c46ed46e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:06.026940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fb9d564f-5210-412e-b95f-1235c46ed46e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:06.029569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fb9d564f-5210-412e-b95f-1235c46ed46e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:06.030420 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fb9d564f-5210-412e-b95f-1235c46ed46e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:06.030865 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fb9d564f-5210-412e-b95f-1235c46ed46e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:06.046781 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-fb9d564f-5210-412e-b95f-1235c46ed46e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] HTTP exception thrown: Instance f7d1447f-444f-4e0c-a20d-9350788fd819 could not be found. May 13 13:29:06.048565 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-fb9d564f-5210-412e-b95f-1235c46ed46e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Request method failure captured: May 13 13:29:06.048565 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819 HTTP/1.1 May 13 13:29:06.048565 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:29:06.048565 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:29:06.048565 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:29:06.048565 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:29:06.048565 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:29:06.048565 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:29:06.048565 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:29:06.048565 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:29:06.048565 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiflwBMboKTbh58LY9MV46SCnkvCoDA8Lz7MKk4gwRCoxQPs10Nennf59WSFpA35k2_OuVUqc3Ildqh9KXOiYz1kwf-o_5U0rFqJBoVhvd5RC1KNKMiAiCN3X4-U5A2Z5o8ov4tv4DHgjoV-mWgbm8gyYcnkReiO1lr3jQvWIeRv7-V3g May 13 13:29:06.048565 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:29:06.048565 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:29:06.048565 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:29:06.048565 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:29:06.048565 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:29:06.048565 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:29:06.048565 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:29:06.048565 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:29:06.048565 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:29:06.048565 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:29:06.050138 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2c900748e271404bb3cb11fb2308e784", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}] May 13 13:29:06.050138 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:29:06.050138 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:29:06.050138 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:29:06.050138 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:29:06.050138 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:29:06.050138 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:29:06.050138 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: e25df7c837584b19afe274f6edfb8efd May 13 13:29:06.050138 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:29:06.050138 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: > May 13 13:29:06.050138 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Instance f7d1447f-444f-4e0c-a20d-9350788fd819 could not be found. May 13 13:29:06.050138 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': 'f7d1447f-444f-4e0c-a20d-9350788fd819'} May 13 13:29:06.050967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:29:06.050967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:29:06.050967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:29:06.050967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:29:06.050967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:29:06.050967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:29:06.050967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:29:06.050967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:29:06.050967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:29:06.050967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:29:06.050967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7d1447f-444f-4e0c-a20d-9350788fd819 could not be found. May 13 13:29:06.050967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:29:06.050967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:29:06.050967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:29:06.050967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:29:06.050967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:29:06.050967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:29:06.050967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:29:06.050967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:29:06.050967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:29:06.052187 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:29:06.052187 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:29:06.052187 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:29:06.052187 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:29:06.052187 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:29:06.052187 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:29:06.052187 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:29:06.052187 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7d1447f-444f-4e0c-a20d-9350788fd819 could not be found. May 13 13:29:06.052187 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:29:06.052187 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:29:06.052187 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:29:06.052187 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:29:06.052187 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:29:06.052187 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:29:06.052187 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:29:06.052187 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:29:06.052187 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7d1447f-444f-4e0c-a20d-9350788fd819 could not be found. May 13 13:29:06.052187 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:29:06.053275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-fb9d564f-5210-412e-b95f-1235c46ed46e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Returning 404 to user: Instance f7d1447f-444f-4e0c-a20d-9350788fd819 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:29:06.053275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-fb9d564f-5210-412e-b95f-1235c46ed46e tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819" status: 404 len: 111 microversion: 2.1 time: 0.034059 May 13 13:29:06.053275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 381/750] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:29:06 2022] GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:29:06.059496 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-915052df-26c4-456e-8713-e3cb2083cc0a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '.version_select at 0x7fb08411c9d0>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:06.171824 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-915052df-26c4-456e-8713-e3cb2083cc0a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1998875009" status: 202 len: 0 microversion: 2.1 time: 0.116348 May 13 13:29:06.179987 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 370/751] 10.222.0.13 () {58 vars in 1220 bytes} [Fri May 13 13:29:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1998875009 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 13:29:06.428239 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8259e082-b2b1-4673-a751-408259fb69fa tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:06.428239 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8259e082-b2b1-4673-a751-408259fb69fa tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:06.433493 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8259e082-b2b1-4673-a751-408259fb69fa tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:06.433493 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8259e082-b2b1-4673-a751-408259fb69fa tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:06.436779 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8259e082-b2b1-4673-a751-408259fb69fa tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:06.436779 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8259e082-b2b1-4673-a751-408259fb69fa tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:06.743649 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8259e082-b2b1-4673-a751-408259fb69fa tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:06.752702 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8259e082-b2b1-4673-a751-408259fb69fa tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:06.754227 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8259e082-b2b1-4673-a751-408259fb69fa tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:06.755384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8259e082-b2b1-4673-a751-408259fb69fa tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1739 microversion: 2.20 time: 0.335203 May 13 13:29:06.756363 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 382/752] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:06 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1739 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:07.191873 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6954a7b3-9a6c-49e1-bb89-246d32cf5130 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Action: 'create', calling method: .version_select at 0x7fb08946ec10>, body: {"keypair": {"name": "tempest-keypair-200539823", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8dlGhAlp9Nvf3GiiM+uvS3PxByx1WytKxE7gbc85RtkNOBaZeDoNyGZ2OfUmiEICC9R2w4zQBa+gqC75jH+NFsSut69zyR76mUKMfQWfYyk3CE5ybGdpZewgLQbfmYCg=="}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:07.227533 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-6954a7b3-9a6c-49e1-bb89-246d32cf5130 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Getting quotas for project 2c900748e271404bb3cb11fb2308e784. Resources: {'key_pairs'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:29:07.235782 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-6954a7b3-9a6c-49e1-bb89-246d32cf5130 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Getting quotas for user e25df7c837584b19afe274f6edfb8efd and project 2c900748e271404bb3cb11fb2308e784. Resources: {'key_pairs'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:29:07.368303 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-33ce42e2-8a1c-4f98-a673-c26cc6bffa3d req-ba6c8e86-2086-4dfa-bfd8-6917e6a7aab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "274c20ca-135a-48d9-85e5-7c99cf77f68d", "name": "network-vif-plugged", "status": "completed", "tag": "729dc6f6-46b1-4dac-a320-fa9e54753c1c"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:07.390895 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-33ce42e2-8a1c-4f98-a673-c26cc6bffa3d req-ba6c8e86-2086-4dfa-bfd8-6917e6a7aab9 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:07.392636 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-33ce42e2-8a1c-4f98-a673-c26cc6bffa3d req-ba6c8e86-2086-4dfa-bfd8-6917e6a7aab9 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:07.444687 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-33ce42e2-8a1c-4f98-a673-c26cc6bffa3d req-ba6c8e86-2086-4dfa-bfd8-6917e6a7aab9 service nova] Creating event network-vif-plugged:729dc6f6-46b1-4dac-a320-fa9e54753c1c for instance 274c20ca-135a-48d9-85e5-7c99cf77f68d on hv-cinder-84163 May 13 13:29:07.452773 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6954a7b3-9a6c-49e1-bb89-246d32cf5130 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.265681 May 13 13:29:07.454764 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 383/753] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 13 13:29:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:07.463779 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-33ce42e2-8a1c-4f98-a673-c26cc6bffa3d req-ba6c8e86-2086-4dfa-bfd8-6917e6a7aab9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.324880 May 13 13:29:07.467808 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 371/754] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:07.775678 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ae8d3d22-5b88-46aa-adc5-b401f741680d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:07.776694 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ae8d3d22-5b88-46aa-adc5-b401f741680d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:07.786835 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ae8d3d22-5b88-46aa-adc5-b401f741680d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:07.787665 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ae8d3d22-5b88-46aa-adc5-b401f741680d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:07.788800 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ae8d3d22-5b88-46aa-adc5-b401f741680d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:07.789448 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ae8d3d22-5b88-46aa-adc5-b401f741680d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:08.031146 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ae8d3d22-5b88-46aa-adc5-b401f741680d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:08.043848 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ae8d3d22-5b88-46aa-adc5-b401f741680d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:08.048527 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ae8d3d22-5b88-46aa-adc5-b401f741680d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:08.049237 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ae8d3d22-5b88-46aa-adc5-b401f741680d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1739 microversion: 2.20 time: 0.277580 May 13 13:29:08.050827 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 384/755] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:07 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1739 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:09.073601 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-18ed024f-ff03-440c-8847-b0f2ab30a5bf tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:09.075212 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-18ed024f-ff03-440c-8847-b0f2ab30a5bf tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:09.083030 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-18ed024f-ff03-440c-8847-b0f2ab30a5bf tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:09.083964 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-18ed024f-ff03-440c-8847-b0f2ab30a5bf tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:09.085007 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-18ed024f-ff03-440c-8847-b0f2ab30a5bf tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:09.085782 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-18ed024f-ff03-440c-8847-b0f2ab30a5bf tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:09.294501 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-18ed024f-ff03-440c-8847-b0f2ab30a5bf tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:09.306277 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-18ed024f-ff03-440c-8847-b0f2ab30a5bf tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:09.311027 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-18ed024f-ff03-440c-8847-b0f2ab30a5bf tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:09.313201 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-18ed024f-ff03-440c-8847-b0f2ab30a5bf tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1739 microversion: 2.20 time: 0.245817 May 13 13:29:09.326095 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 372/756] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:09 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1739 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:10.333814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5c584467-bf85-4f0b-af82-ac3d23c7ecd5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:10.337850 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5c584467-bf85-4f0b-af82-ac3d23c7ecd5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:10.342510 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5c584467-bf85-4f0b-af82-ac3d23c7ecd5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:10.342983 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5c584467-bf85-4f0b-af82-ac3d23c7ecd5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:10.343986 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5c584467-bf85-4f0b-af82-ac3d23c7ecd5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:10.344425 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5c584467-bf85-4f0b-af82-ac3d23c7ecd5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:10.501614 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5c584467-bf85-4f0b-af82-ac3d23c7ecd5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:10.510597 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5c584467-bf85-4f0b-af82-ac3d23c7ecd5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:10.512255 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5c584467-bf85-4f0b-af82-ac3d23c7ecd5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:10.513669 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5c584467-bf85-4f0b-af82-ac3d23c7ecd5 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1739 microversion: 2.20 time: 0.184775 May 13 13:29:10.514337 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 385/757] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:10 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:10.713520 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a2800f97-0f8f-4684-9f8c-4e559ec7c7f3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-501110298", "imageRef": "ece294e8-5415-4d6a-a0d3-a14539c51c0a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc71e07c-eb5e-4e51-82e1-4253b2766878"}], "security_groups": [{"name": "tempest-securitygroup--948858112"}], "key_name": "tempest-keypair-200539823", "user_data": "}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:10.833471 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.network.neutron [None req-a2800f97-0f8f-4684-9f8c-4e559ec7c7f3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] validate_networks() for [('fc71e07c-eb5e-4e51-82e1-4253b2766878', None, None, None, None, None)] {{(pid=117720) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:29:11.420407 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-a2800f97-0f8f-4684-9f8c-4e559ec7c7f3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Flavor limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:29:11.421145 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-a2800f97-0f8f-4684-9f8c-4e559ec7c7f3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Image limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:29:11.421904 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-a2800f97-0f8f-4684-9f8c-4e559ec7c7f3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Flavor pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:29:11.422348 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-a2800f97-0f8f-4684-9f8c-4e559ec7c7f3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Image pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:29:11.422756 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-a2800f97-0f8f-4684-9f8c-4e559ec7c7f3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:29:11.432526 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a2800f97-0f8f-4684-9f8c-4e559ec7c7f3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:11.433394 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a2800f97-0f8f-4684-9f8c-4e559ec7c7f3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:11.434342 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a2800f97-0f8f-4684-9f8c-4e559ec7c7f3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:11.434880 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a2800f97-0f8f-4684-9f8c-4e559ec7c7f3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:11.455396 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-a2800f97-0f8f-4684-9f8c-4e559ec7c7f3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Getting quotas for project 2c900748e271404bb3cb11fb2308e784. Resources: {'cores', 'instances', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:29:11.459767 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-a2800f97-0f8f-4684-9f8c-4e559ec7c7f3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Getting quotas for user e25df7c837584b19afe274f6edfb8efd and project 2c900748e271404bb3cb11fb2308e784. Resources: {'cores', 'instances', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:29:11.475616 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a2800f97-0f8f-4684-9f8c-4e559ec7c7f3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Going to run 1 instances... {{(pid=117720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:29:11.478398 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a2800f97-0f8f-4684-9f8c-4e559ec7c7f3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ece294e8-5415-4d6a-a0d3-a14539c51c0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:29:11.534549 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2833ec9e-03bf-4bc1-810b-90fb59ba5796 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:11.538862 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2833ec9e-03bf-4bc1-810b-90fb59ba5796 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:11.553064 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2833ec9e-03bf-4bc1-810b-90fb59ba5796 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:11.554100 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2833ec9e-03bf-4bc1-810b-90fb59ba5796 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:11.555353 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2833ec9e-03bf-4bc1-810b-90fb59ba5796 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:11.555943 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2833ec9e-03bf-4bc1-810b-90fb59ba5796 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:11.683682 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a2800f97-0f8f-4684-9f8c-4e559ec7c7f3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.974129 May 13 13:29:11.684954 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 373/758] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 13 13:29:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:29:11.718384 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-65da4975-34cf-4c6e-9894-ba824debff58 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:11.729407 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-65da4975-34cf-4c6e-9894-ba824debff58 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:11.826991 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-65da4975-34cf-4c6e-9894-ba824debff58 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:11.838011 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-65da4975-34cf-4c6e-9894-ba824debff58 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337" status: 200 len: 1240 microversion: 2.1 time: 0.142662 May 13 13:29:11.838632 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 374/759] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:29:11 2022] GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337 => generated 1240 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:11.856810 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2833ec9e-03bf-4bc1-810b-90fb59ba5796 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:11.866548 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2833ec9e-03bf-4bc1-810b-90fb59ba5796 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:11.868678 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2833ec9e-03bf-4bc1-810b-90fb59ba5796 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:11.871505 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2833ec9e-03bf-4bc1-810b-90fb59ba5796 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1739 microversion: 2.20 time: 0.340950 May 13 13:29:11.877582 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 386/760] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:11 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1739 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:29:12.858305 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3f271f82-6b9b-4cb6-ad01-a8c2f7998afc tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:12.859054 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3f271f82-6b9b-4cb6-ad01-a8c2f7998afc tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:12.892298 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7a8a397a-c517-4d52-9f99-571bcd76c601 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:12.893094 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7a8a397a-c517-4d52-9f99-571bcd76c601 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:12.904171 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7a8a397a-c517-4d52-9f99-571bcd76c601 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:12.906030 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7a8a397a-c517-4d52-9f99-571bcd76c601 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:12.907559 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7a8a397a-c517-4d52-9f99-571bcd76c601 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:12.909565 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7a8a397a-c517-4d52-9f99-571bcd76c601 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:12.957697 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3f271f82-6b9b-4cb6-ad01-a8c2f7998afc tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:12.966256 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3f271f82-6b9b-4cb6-ad01-a8c2f7998afc tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337" status: 200 len: 1240 microversion: 2.1 time: 0.112714 May 13 13:29:12.970519 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 375/761] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:29:12 2022] GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337 => generated 1240 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:13.112203 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7a8a397a-c517-4d52-9f99-571bcd76c601 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:13.121772 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7a8a397a-c517-4d52-9f99-571bcd76c601 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:13.123315 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7a8a397a-c517-4d52-9f99-571bcd76c601 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:13.124486 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7a8a397a-c517-4d52-9f99-571bcd76c601 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1739 microversion: 2.20 time: 0.236266 May 13 13:29:13.125366 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 387/762] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:12 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:13.986109 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b68d3fac-e22b-43ae-a2e9-623a54664e9b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:13.986712 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b68d3fac-e22b-43ae-a2e9-623a54664e9b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:13.993823 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b68d3fac-e22b-43ae-a2e9-623a54664e9b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:13.994293 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b68d3fac-e22b-43ae-a2e9-623a54664e9b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:13.995064 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b68d3fac-e22b-43ae-a2e9-623a54664e9b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:13.995524 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b68d3fac-e22b-43ae-a2e9-623a54664e9b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:14.064041 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b68d3fac-e22b-43ae-a2e9-623a54664e9b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:14.072383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b68d3fac-e22b-43ae-a2e9-623a54664e9b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337" status: 200 len: 1244 microversion: 2.1 time: 0.090275 May 13 13:29:14.073247 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 376/763] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:29:13 2022] GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337 => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:14.146304 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-42f36b43-9877-4e3a-a299-ab9dc16e4da0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:14.146885 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-42f36b43-9877-4e3a-a299-ab9dc16e4da0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:14.153550 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-42f36b43-9877-4e3a-a299-ab9dc16e4da0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:14.153983 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-42f36b43-9877-4e3a-a299-ab9dc16e4da0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:14.155189 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-42f36b43-9877-4e3a-a299-ab9dc16e4da0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:14.155690 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-42f36b43-9877-4e3a-a299-ab9dc16e4da0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:14.298062 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-42f36b43-9877-4e3a-a299-ab9dc16e4da0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:14.307400 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-42f36b43-9877-4e3a-a299-ab9dc16e4da0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:14.310088 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-42f36b43-9877-4e3a-a299-ab9dc16e4da0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:14.311428 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-42f36b43-9877-4e3a-a299-ab9dc16e4da0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1739 microversion: 2.20 time: 0.171719 May 13 13:29:14.322939 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 388/764] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:14 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:15.102443 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7d49f145-2864-4150-985d-da0ea0589de7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:15.103570 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7d49f145-2864-4150-985d-da0ea0589de7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:15.125924 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7d49f145-2864-4150-985d-da0ea0589de7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:15.126418 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7d49f145-2864-4150-985d-da0ea0589de7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:15.127221 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7d49f145-2864-4150-985d-da0ea0589de7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:15.127658 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7d49f145-2864-4150-985d-da0ea0589de7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:15.239848 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7d49f145-2864-4150-985d-da0ea0589de7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:15.251151 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7d49f145-2864-4150-985d-da0ea0589de7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337" status: 200 len: 1292 microversion: 2.1 time: 0.163872 May 13 13:29:15.263319 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 377/765] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:29:15 2022] GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337 => generated 1292 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:15.313029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-41185242-3a37-4441-ba61-6ab57dbbdaa3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:15.318487 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-41185242-3a37-4441-ba61-6ab57dbbdaa3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:15.322706 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-41185242-3a37-4441-ba61-6ab57dbbdaa3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:15.323440 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-41185242-3a37-4441-ba61-6ab57dbbdaa3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:15.329557 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0f5980f5-3462-4ab3-b600-38d3c43027c4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:15.330282 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0f5980f5-3462-4ab3-b600-38d3c43027c4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:15.338268 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0f5980f5-3462-4ab3-b600-38d3c43027c4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:15.339018 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-41185242-3a37-4441-ba61-6ab57dbbdaa3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:15.339607 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-41185242-3a37-4441-ba61-6ab57dbbdaa3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:15.343224 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0f5980f5-3462-4ab3-b600-38d3c43027c4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:15.344075 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0f5980f5-3462-4ab3-b600-38d3c43027c4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:15.344519 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0f5980f5-3462-4ab3-b600-38d3c43027c4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:15.404221 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-41185242-3a37-4441-ba61-6ab57dbbdaa3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096007 May 13 13:29:15.405759 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 389/766] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 13 13:29:15 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:15.418816 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-11f30928-2a79-4506-a43b-ec9ae268aa87 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:15.426986 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-11f30928-2a79-4506-a43b-ec9ae268aa87 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:15.446760 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-11f30928-2a79-4506-a43b-ec9ae268aa87 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:15.447617 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-11f30928-2a79-4506-a43b-ec9ae268aa87 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:15.448964 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-11f30928-2a79-4506-a43b-ec9ae268aa87 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:15.450851 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-11f30928-2a79-4506-a43b-ec9ae268aa87 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:15.521096 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-11f30928-2a79-4506-a43b-ec9ae268aa87 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/os-volume_attachments/a1db76e0-c82c-42e2-ab47-b870c7f61eae" status: 200 len: 194 microversion: 2.1 time: 0.107796 May 13 13:29:15.522229 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 390/767] 10.222.0.13 () {58 vars in 1412 bytes} [Fri May 13 13:29:15 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/os-volume_attachments/a1db76e0-c82c-42e2-ab47-b870c7f61eae => generated 194 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:15.585246 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0f5980f5-3462-4ab3-b600-38d3c43027c4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:15.595487 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0f5980f5-3462-4ab3-b600-38d3c43027c4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:15.597513 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0f5980f5-3462-4ab3-b600-38d3c43027c4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:15.598723 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0f5980f5-3462-4ab3-b600-38d3c43027c4 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1739 microversion: 2.20 time: 0.273293 May 13 13:29:15.599501 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 378/768] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:15 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1739 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:16.273774 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-bd3338c6-3f46-4420-951b-3d1fa93fd544 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:16.275352 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-bd3338c6-3f46-4420-951b-3d1fa93fd544 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:16.283794 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bd3338c6-3f46-4420-951b-3d1fa93fd544 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:16.284316 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bd3338c6-3f46-4420-951b-3d1fa93fd544 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:16.285178 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bd3338c6-3f46-4420-951b-3d1fa93fd544 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:16.285686 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bd3338c6-3f46-4420-951b-3d1fa93fd544 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:16.418145 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-bd3338c6-3f46-4420-951b-3d1fa93fd544 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:16.430846 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-bd3338c6-3f46-4420-951b-3d1fa93fd544 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337" status: 200 len: 1298 microversion: 2.1 time: 0.165613 May 13 13:29:16.441763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 391/769] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:29:16 2022] GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337 => generated 1298 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:16.638230 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-415d53be-11a4-4ab8-9181-d39c8029e176 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:16.638230 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-415d53be-11a4-4ab8-9181-d39c8029e176 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:16.662243 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-415d53be-11a4-4ab8-9181-d39c8029e176 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:16.662243 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-415d53be-11a4-4ab8-9181-d39c8029e176 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:16.662243 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-415d53be-11a4-4ab8-9181-d39c8029e176 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:16.662243 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-415d53be-11a4-4ab8-9181-d39c8029e176 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:16.902591 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-415d53be-11a4-4ab8-9181-d39c8029e176 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:16.918492 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-415d53be-11a4-4ab8-9181-d39c8029e176 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:16.920429 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-415d53be-11a4-4ab8-9181-d39c8029e176 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:16.921837 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-415d53be-11a4-4ab8-9181-d39c8029e176 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1739 microversion: 2.20 time: 0.298333 May 13 13:29:16.922601 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 379/770] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:16 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1739 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:17.515322 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1a96fb54-eb51-46e5-af0e-2046fa770ae0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:17.515946 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1a96fb54-eb51-46e5-af0e-2046fa770ae0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:17.523056 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1a96fb54-eb51-46e5-af0e-2046fa770ae0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:17.524412 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1a96fb54-eb51-46e5-af0e-2046fa770ae0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:17.525276 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1a96fb54-eb51-46e5-af0e-2046fa770ae0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:17.525776 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1a96fb54-eb51-46e5-af0e-2046fa770ae0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:17.529280 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-85ba8edc-dbb2-4c2f-b450-616074dd5a81 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6bdb0576-4ccd-4fa4-a1ff-8c1e2aeb8d5a"}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:17.530432 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-85ba8edc-dbb2-4c2f-b450-616074dd5a81 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:17.537730 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-85ba8edc-dbb2-4c2f-b450-616074dd5a81 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:17.538180 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-85ba8edc-dbb2-4c2f-b450-616074dd5a81 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:17.538986 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-85ba8edc-dbb2-4c2f-b450-616074dd5a81 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:17.539467 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-85ba8edc-dbb2-4c2f-b450-616074dd5a81 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:17.702027 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1a96fb54-eb51-46e5-af0e-2046fa770ae0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:17.702027 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1a96fb54-eb51-46e5-af0e-2046fa770ae0 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337" status: 200 len: 1365 microversion: 2.1 time: 0.250745 May 13 13:29:17.702027 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 392/771] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:29:17 2022] GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337 => generated 1365 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:17.940814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-62bc6ac3-5564-4952-a9f2-5b6563b7afc6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:17.941354 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-62bc6ac3-5564-4952-a9f2-5b6563b7afc6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:17.947277 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-62bc6ac3-5564-4952-a9f2-5b6563b7afc6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:17.947751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-62bc6ac3-5564-4952-a9f2-5b6563b7afc6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:17.948511 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-62bc6ac3-5564-4952-a9f2-5b6563b7afc6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:17.949657 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-62bc6ac3-5564-4952-a9f2-5b6563b7afc6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:18.106857 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-62bc6ac3-5564-4952-a9f2-5b6563b7afc6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:18.116115 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-62bc6ac3-5564-4952-a9f2-5b6563b7afc6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:18.117613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-62bc6ac3-5564-4952-a9f2-5b6563b7afc6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:18.118810 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-62bc6ac3-5564-4952-a9f2-5b6563b7afc6 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1739 microversion: 2.20 time: 0.182001 May 13 13:29:18.119374 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 393/772] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:17 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:29:18.364584 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-1bee4084-1dd5-4725-9bf5-072314ae867f req-81cca0f6-4a83-4276-bb7e-d792568c339b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "835a8273-f466-42d9-818d-17b347b44337", "tag": "78f7e4a5-db41-4b56-9671-ed755318389e"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:18.374670 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-1bee4084-1dd5-4725-9bf5-072314ae867f req-81cca0f6-4a83-4276-bb7e-d792568c339b service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:18.375126 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-1bee4084-1dd5-4725-9bf5-072314ae867f req-81cca0f6-4a83-4276-bb7e-d792568c339b service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:18.393618 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-1bee4084-1dd5-4725-9bf5-072314ae867f req-81cca0f6-4a83-4276-bb7e-d792568c339b service nova] Creating event network-changed:78f7e4a5-db41-4b56-9671-ed755318389e for instance 835a8273-f466-42d9-818d-17b347b44337 on hv-cinder-84163 May 13 13:29:18.399459 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-1bee4084-1dd5-4725-9bf5-072314ae867f req-81cca0f6-4a83-4276-bb7e-d792568c339b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038464 May 13 13:29:18.407112 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 394/773] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:18.716246 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e7290949-fc2d-4adb-8ffe-4b0763590591 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:18.723289 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e7290949-fc2d-4adb-8ffe-4b0763590591 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:18.735570 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e7290949-fc2d-4adb-8ffe-4b0763590591 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:18.736279 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e7290949-fc2d-4adb-8ffe-4b0763590591 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:18.737454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e7290949-fc2d-4adb-8ffe-4b0763590591 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:18.738043 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e7290949-fc2d-4adb-8ffe-4b0763590591 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:18.988646 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e7290949-fc2d-4adb-8ffe-4b0763590591 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:19.002919 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e7290949-fc2d-4adb-8ffe-4b0763590591 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337" status: 200 len: 1365 microversion: 2.1 time: 0.290683 May 13 13:29:19.004569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 395/774] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:29:18 2022] GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337 => generated 1365 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:19.037794 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-85ba8edc-dbb2-4c2f-b450-616074dd5a81 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "POST /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.512832 May 13 13:29:19.039836 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 380/775] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 13 13:29:17 2022] POST /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/os-volume_attachments => generated 194 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:29:19.137903 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-96f253fb-18c5-451e-b899-8c1688f11e46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:19.141754 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-96f253fb-18c5-451e-b899-8c1688f11e46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:19.153809 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-96f253fb-18c5-451e-b899-8c1688f11e46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:19.155871 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-96f253fb-18c5-451e-b899-8c1688f11e46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:19.156944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-96f253fb-18c5-451e-b899-8c1688f11e46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:19.158272 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-96f253fb-18c5-451e-b899-8c1688f11e46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:19.374630 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-96f253fb-18c5-451e-b899-8c1688f11e46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:19.383117 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-96f253fb-18c5-451e-b899-8c1688f11e46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:19.384725 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-96f253fb-18c5-451e-b899-8c1688f11e46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:19.385963 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-96f253fb-18c5-451e-b899-8c1688f11e46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1739 microversion: 2.20 time: 0.252161 May 13 13:29:19.397690 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 396/776] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:19 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:20.022048 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-904febd6-06a6-43fa-93c8-e7485b9bdf45 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:20.022665 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-904febd6-06a6-43fa-93c8-e7485b9bdf45 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:20.029600 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-904febd6-06a6-43fa-93c8-e7485b9bdf45 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:20.030051 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-904febd6-06a6-43fa-93c8-e7485b9bdf45 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:20.030911 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-904febd6-06a6-43fa-93c8-e7485b9bdf45 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:20.031379 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-904febd6-06a6-43fa-93c8-e7485b9bdf45 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:20.167940 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-904febd6-06a6-43fa-93c8-e7485b9bdf45 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:20.175813 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-904febd6-06a6-43fa-93c8-e7485b9bdf45 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337" status: 200 len: 1365 microversion: 2.1 time: 0.158680 May 13 13:29:20.186098 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 381/777] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:29:20 2022] GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:20.406687 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-948ea5dd-aa5a-411a-989c-10c40780a53a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:20.407645 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-948ea5dd-aa5a-411a-989c-10c40780a53a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:20.414063 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-948ea5dd-aa5a-411a-989c-10c40780a53a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:20.414544 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-948ea5dd-aa5a-411a-989c-10c40780a53a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:20.415310 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-948ea5dd-aa5a-411a-989c-10c40780a53a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:20.415742 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-948ea5dd-aa5a-411a-989c-10c40780a53a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:20.555791 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-948ea5dd-aa5a-411a-989c-10c40780a53a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:20.569556 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-948ea5dd-aa5a-411a-989c-10c40780a53a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:20.571131 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-948ea5dd-aa5a-411a-989c-10c40780a53a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:20.572358 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-948ea5dd-aa5a-411a-989c-10c40780a53a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1739 microversion: 2.20 time: 0.171197 May 13 13:29:20.572891 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 397/778] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:20 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:21.195476 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ee014df5-fe50-42b6-befe-85807a90c352 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:21.195923 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ee014df5-fe50-42b6-befe-85807a90c352 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:21.204249 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ee014df5-fe50-42b6-befe-85807a90c352 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:21.205036 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ee014df5-fe50-42b6-befe-85807a90c352 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:21.206600 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ee014df5-fe50-42b6-befe-85807a90c352 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:21.207281 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ee014df5-fe50-42b6-befe-85807a90c352 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:21.349040 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ee014df5-fe50-42b6-befe-85807a90c352 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:21.356709 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ee014df5-fe50-42b6-befe-85807a90c352 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337" status: 200 len: 1365 microversion: 2.1 time: 0.166198 May 13 13:29:21.366072 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 382/779] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:29:21 2022] GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:21.596692 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2b32eacc-70e3-418e-a2d6-07e7c6265fce tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:21.612752 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2b32eacc-70e3-418e-a2d6-07e7c6265fce tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:21.612752 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2b32eacc-70e3-418e-a2d6-07e7c6265fce tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:21.612752 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2b32eacc-70e3-418e-a2d6-07e7c6265fce tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:21.612752 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2b32eacc-70e3-418e-a2d6-07e7c6265fce tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:21.613216 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2b32eacc-70e3-418e-a2d6-07e7c6265fce tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:21.755440 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2b32eacc-70e3-418e-a2d6-07e7c6265fce tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:21.764974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2b32eacc-70e3-418e-a2d6-07e7c6265fce tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:21.766599 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2b32eacc-70e3-418e-a2d6-07e7c6265fce tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:21.767897 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2b32eacc-70e3-418e-a2d6-07e7c6265fce tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1721 microversion: 2.20 time: 0.175447 May 13 13:29:21.768494 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 398/780] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:21 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:22.373672 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-fd7a1f5a-7ac3-42cb-a5c9-520e3e04968d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:22.374335 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-fd7a1f5a-7ac3-42cb-a5c9-520e3e04968d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:22.380783 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd7a1f5a-7ac3-42cb-a5c9-520e3e04968d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:22.381241 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd7a1f5a-7ac3-42cb-a5c9-520e3e04968d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:22.382525 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd7a1f5a-7ac3-42cb-a5c9-520e3e04968d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:22.383271 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd7a1f5a-7ac3-42cb-a5c9-520e3e04968d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:22.548164 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fd7a1f5a-7ac3-42cb-a5c9-520e3e04968d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:22.556065 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-fd7a1f5a-7ac3-42cb-a5c9-520e3e04968d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337" status: 200 len: 1365 microversion: 2.1 time: 0.186895 May 13 13:29:22.559593 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 383/781] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:29:22 2022] GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:22.786073 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b4db5d50-b275-4794-a64e-25f15d4c3942 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:22.786692 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b4db5d50-b275-4794-a64e-25f15d4c3942 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:22.793234 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b4db5d50-b275-4794-a64e-25f15d4c3942 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:22.794298 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b4db5d50-b275-4794-a64e-25f15d4c3942 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:22.794453 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b4db5d50-b275-4794-a64e-25f15d4c3942 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:22.794883 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b4db5d50-b275-4794-a64e-25f15d4c3942 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:22.924835 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b4db5d50-b275-4794-a64e-25f15d4c3942 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:22.932826 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b4db5d50-b275-4794-a64e-25f15d4c3942 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:22.934658 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b4db5d50-b275-4794-a64e-25f15d4c3942 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:22.935823 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b4db5d50-b275-4794-a64e-25f15d4c3942 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1721 microversion: 2.20 time: 0.153742 May 13 13:29:22.936384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 399/782] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:22 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:23.487488 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-778530e3-3c02-4b55-84c9-9144e6d46bc9 req-161a2a3a-9d53-455c-9b77-58ef8a9806ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "835a8273-f466-42d9-818d-17b347b44337", "name": "network-vif-plugged", "status": "completed", "tag": "78f7e4a5-db41-4b56-9671-ed755318389e"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:23.494833 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-778530e3-3c02-4b55-84c9-9144e6d46bc9 req-161a2a3a-9d53-455c-9b77-58ef8a9806ba service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:23.495270 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-778530e3-3c02-4b55-84c9-9144e6d46bc9 req-161a2a3a-9d53-455c-9b77-58ef8a9806ba service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:23.507798 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-778530e3-3c02-4b55-84c9-9144e6d46bc9 req-161a2a3a-9d53-455c-9b77-58ef8a9806ba service nova] Creating event network-vif-plugged:78f7e4a5-db41-4b56-9671-ed755318389e for instance 835a8273-f466-42d9-818d-17b347b44337 on hv-cinder-84163 May 13 13:29:23.513429 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-778530e3-3c02-4b55-84c9-9144e6d46bc9 req-161a2a3a-9d53-455c-9b77-58ef8a9806ba service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032555 May 13 13:29:23.514027 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 384/783] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:23.576646 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5587b025-6352-474e-8ce6-cdb119fc486d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:23.577594 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5587b025-6352-474e-8ce6-cdb119fc486d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:23.586375 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5587b025-6352-474e-8ce6-cdb119fc486d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:23.587295 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5587b025-6352-474e-8ce6-cdb119fc486d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:23.588582 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5587b025-6352-474e-8ce6-cdb119fc486d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:23.589857 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5587b025-6352-474e-8ce6-cdb119fc486d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:23.770164 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5587b025-6352-474e-8ce6-cdb119fc486d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:23.778534 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5587b025-6352-474e-8ce6-cdb119fc486d tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337" status: 200 len: 1365 microversion: 2.1 time: 0.208507 May 13 13:29:23.779130 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 400/784] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:29:23 2022] GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337 => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:23.955206 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e611e20c-3c3c-4f91-af24-bdb7e5c76211 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:23.955886 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e611e20c-3c3c-4f91-af24-bdb7e5c76211 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:23.963536 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e611e20c-3c3c-4f91-af24-bdb7e5c76211 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:23.963975 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e611e20c-3c3c-4f91-af24-bdb7e5c76211 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:23.965955 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e611e20c-3c3c-4f91-af24-bdb7e5c76211 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:23.966731 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e611e20c-3c3c-4f91-af24-bdb7e5c76211 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:24.108757 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e611e20c-3c3c-4f91-af24-bdb7e5c76211 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:24.117404 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e611e20c-3c3c-4f91-af24-bdb7e5c76211 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:24.121578 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e611e20c-3c3c-4f91-af24-bdb7e5c76211 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:24.121578 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e611e20c-3c3c-4f91-af24-bdb7e5c76211 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1664 microversion: 2.20 time: 0.169395 May 13 13:29:24.122299 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 385/785] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:23 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1664 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:24.139333 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2dca27e8-59a2-4768-8d12-98572cb264d7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff08d494-51a1-4b11-b510-cdfe88b769a3"}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:24.140464 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2dca27e8-59a2-4768-8d12-98572cb264d7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:24.146897 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2dca27e8-59a2-4768-8d12-98572cb264d7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:24.147341 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2dca27e8-59a2-4768-8d12-98572cb264d7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:24.148344 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2dca27e8-59a2-4768-8d12-98572cb264d7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:24.149347 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2dca27e8-59a2-4768-8d12-98572cb264d7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:24.796040 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-04142527-dc79-4c63-b882-f11e10797ea2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:24.796735 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-04142527-dc79-4c63-b882-f11e10797ea2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:24.803495 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-04142527-dc79-4c63-b882-f11e10797ea2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:24.803937 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-04142527-dc79-4c63-b882-f11e10797ea2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:24.804796 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-04142527-dc79-4c63-b882-f11e10797ea2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:24.805225 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-04142527-dc79-4c63-b882-f11e10797ea2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:24.948782 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-04142527-dc79-4c63-b882-f11e10797ea2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:24.956792 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-04142527-dc79-4c63-b882-f11e10797ea2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337" status: 200 len: 1365 microversion: 2.1 time: 0.165401 May 13 13:29:24.957373 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 386/786] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:29:24 2022] GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:25.279410 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2dca27e8-59a2-4768-8d12-98572cb264d7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "POST /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.144958 May 13 13:29:25.280561 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 401/787] 10.222.0.13 () {62 vars in 1363 bytes} [Fri May 13 13:29:24 2022] POST /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d/os-volume_attachments => generated 188 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 13:29:25.409770 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6b47ab43-7465-47d5-b808-947df5d0c999 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:25.410299 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6b47ab43-7465-47d5-b808-947df5d0c999 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:25.417135 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6b47ab43-7465-47d5-b808-947df5d0c999 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:25.418259 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6b47ab43-7465-47d5-b808-947df5d0c999 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:25.419644 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6b47ab43-7465-47d5-b808-947df5d0c999 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:25.420082 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6b47ab43-7465-47d5-b808-947df5d0c999 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:25.537904 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-f92b6991-4bf5-460d-b250-7cba1fc8db5a req-4b4fddec-c8a9-4f32-8cc7-c9982c1c5372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "274c20ca-135a-48d9-85e5-7c99cf77f68d", "name": "network-vif-unplugged", "status": "completed", "tag": "729dc6f6-46b1-4dac-a320-fa9e54753c1c"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:25.550774 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-f92b6991-4bf5-460d-b250-7cba1fc8db5a req-4b4fddec-c8a9-4f32-8cc7-c9982c1c5372 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:25.555437 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-f92b6991-4bf5-460d-b250-7cba1fc8db5a req-4b4fddec-c8a9-4f32-8cc7-c9982c1c5372 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:25.569700 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.compute.server_external_events [req-f92b6991-4bf5-460d-b250-7cba1fc8db5a req-4b4fddec-c8a9-4f32-8cc7-c9982c1c5372 service nova] Unable to find a host for instance 274c20ca-135a-48d9-85e5-7c99cf77f68d. Dropping event network-vif-unplugged {{(pid=117721) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 13 13:29:25.569700 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-f92b6991-4bf5-460d-b250-7cba1fc8db5a req-4b4fddec-c8a9-4f32-8cc7-c9982c1c5372 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.044049 May 13 13:29:25.570449 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 402/788] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 13 13:29:25.976419 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-230b0fcb-68e2-4c85-800c-96f0c506ee79 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:25.977184 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-230b0fcb-68e2-4c85-800c-96f0c506ee79 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:25.985519 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-230b0fcb-68e2-4c85-800c-96f0c506ee79 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:25.986082 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-230b0fcb-68e2-4c85-800c-96f0c506ee79 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:25.986976 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-230b0fcb-68e2-4c85-800c-96f0c506ee79 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:25.987470 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-230b0fcb-68e2-4c85-800c-96f0c506ee79 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:26.113958 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6b47ab43-7465-47d5-b808-947df5d0c999 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "DELETE /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d/os-volume_attachments/ff08d494-51a1-4b11-b510-cdfe88b769a3" status: 202 len: 0 microversion: 2.20 time: 0.707911 May 13 13:29:26.114885 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 387/789] 10.222.0.13 () {60 vars in 1456 bytes} [Fri May 13 13:29:25 2022] DELETE /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d/os-volume_attachments/ff08d494-51a1-4b11-b510-cdfe88b769a3 => generated 0 bytes in 710 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 13:29:26.137899 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-230b0fcb-68e2-4c85-800c-96f0c506ee79 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:26.156421 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-230b0fcb-68e2-4c85-800c-96f0c506ee79 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337" status: 200 len: 1554 microversion: 2.1 time: 0.183815 May 13 13:29:26.157258 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 403/790] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:29:25 2022] GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337 => generated 1554 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:26.175811 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1cce28f8-cae4-486e-aa0c-5e7b454d15b7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:26.179367 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1cce28f8-cae4-486e-aa0c-5e7b454d15b7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:26.179704 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ba1e56bb-b3ed-4c06-8787-b719ce6dde86 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:26.179704 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ba1e56bb-b3ed-4c06-8787-b719ce6dde86 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:26.184454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ba1e56bb-b3ed-4c06-8787-b719ce6dde86 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:26.184799 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ba1e56bb-b3ed-4c06-8787-b719ce6dde86 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:26.185822 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ba1e56bb-b3ed-4c06-8787-b719ce6dde86 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:26.186286 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ba1e56bb-b3ed-4c06-8787-b719ce6dde86 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:26.186777 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1cce28f8-cae4-486e-aa0c-5e7b454d15b7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:26.187323 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1cce28f8-cae4-486e-aa0c-5e7b454d15b7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:26.188509 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1cce28f8-cae4-486e-aa0c-5e7b454d15b7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:26.189176 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1cce28f8-cae4-486e-aa0c-5e7b454d15b7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:26.280782 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ba1e56bb-b3ed-4c06-8787-b719ce6dde86 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108877 May 13 13:29:26.281409 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 404/791] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 13 13:29:26 2022] GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:26.447846 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1cce28f8-cae4-486e-aa0c-5e7b454d15b7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "POST /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d/action" status: 202 len: 0 microversion: 2.20 time: 0.275930 May 13 13:29:26.463231 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 388/792] 10.222.0.13 () {62 vars in 1318 bytes} [Fri May 13 13:29:26 2022] POST /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 13:29:26.464045 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8a92652d-229b-4266-a3f0-adbf157e517f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:26.464045 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8a92652d-229b-4266-a3f0-adbf157e517f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:26.464948 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a92652d-229b-4266-a3f0-adbf157e517f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:26.465400 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a92652d-229b-4266-a3f0-adbf157e517f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:26.466456 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a92652d-229b-4266-a3f0-adbf157e517f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:26.466911 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a92652d-229b-4266-a3f0-adbf157e517f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:26.611832 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8a92652d-229b-4266-a3f0-adbf157e517f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:26.626614 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8a92652d-229b-4266-a3f0-adbf157e517f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:26.628213 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8a92652d-229b-4266-a3f0-adbf157e517f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:26.629475 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8a92652d-229b-4266-a3f0-adbf157e517f tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1672 microversion: 2.20 time: 0.176002 May 13 13:29:26.630265 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 405/793] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:26 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1672 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:29:27.648273 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d805f4e3-2526-41ba-ab83-e55aeb118848 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:27.648888 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d805f4e3-2526-41ba-ab83-e55aeb118848 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:27.655994 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d805f4e3-2526-41ba-ab83-e55aeb118848 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:27.656437 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d805f4e3-2526-41ba-ab83-e55aeb118848 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:27.657317 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d805f4e3-2526-41ba-ab83-e55aeb118848 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:27.657639 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d805f4e3-2526-41ba-ab83-e55aeb118848 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:27.688666 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-d30b2e44-93c3-4d82-942e-e898a318bc04 req-a8e8038f-967a-45dc-b6e0-8ddcb47c7363 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "835a8273-f466-42d9-818d-17b347b44337", "tag": "78f7e4a5-db41-4b56-9671-ed755318389e"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:27.705237 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-d30b2e44-93c3-4d82-942e-e898a318bc04 req-a8e8038f-967a-45dc-b6e0-8ddcb47c7363 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:27.705679 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-d30b2e44-93c3-4d82-942e-e898a318bc04 req-a8e8038f-967a-45dc-b6e0-8ddcb47c7363 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:27.718259 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-d30b2e44-93c3-4d82-942e-e898a318bc04 req-a8e8038f-967a-45dc-b6e0-8ddcb47c7363 service nova] Creating event network-changed:78f7e4a5-db41-4b56-9671-ed755318389e for instance 835a8273-f466-42d9-818d-17b347b44337 on hv-cinder-84163 May 13 13:29:27.724405 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-d30b2e44-93c3-4d82-942e-e898a318bc04 req-a8e8038f-967a-45dc-b6e0-8ddcb47c7363 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040559 May 13 13:29:27.725020 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 406/794] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:27.731810 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4e39eaa3-abc3-4d26-80cb-15cb8b81f09b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:27.733058 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4e39eaa3-abc3-4d26-80cb-15cb8b81f09b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:27.740642 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4e39eaa3-abc3-4d26-80cb-15cb8b81f09b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:27.741503 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4e39eaa3-abc3-4d26-80cb-15cb8b81f09b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:27.742605 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4e39eaa3-abc3-4d26-80cb-15cb8b81f09b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:27.743191 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4e39eaa3-abc3-4d26-80cb-15cb8b81f09b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:27.780315 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4e39eaa3-abc3-4d26-80cb-15cb8b81f09b tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053961 May 13 13:29:27.781093 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 407/795] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 13 13:29:27 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:27.821234 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d805f4e3-2526-41ba-ab83-e55aeb118848 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:27.830166 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d805f4e3-2526-41ba-ab83-e55aeb118848 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:27.831722 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d805f4e3-2526-41ba-ab83-e55aeb118848 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:27.832927 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d805f4e3-2526-41ba-ab83-e55aeb118848 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1672 microversion: 2.20 time: 0.188520 May 13 13:29:27.833726 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 389/796] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:27 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1672 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:27.919953 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-72e563bf-1c08-4659-90fd-9fd20e05c357 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:27.920449 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-72e563bf-1c08-4659-90fd-9fd20e05c357 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:27.926707 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72e563bf-1c08-4659-90fd-9fd20e05c357 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:27.927186 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72e563bf-1c08-4659-90fd-9fd20e05c357 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:27.927970 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72e563bf-1c08-4659-90fd-9fd20e05c357 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:27.928409 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72e563bf-1c08-4659-90fd-9fd20e05c357 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:27.967327 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-72e563bf-1c08-4659-90fd-9fd20e05c357 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/os-volume_attachments/a1db76e0-c82c-42e2-ab47-b870c7f61eae" status: 200 len: 194 microversion: 2.1 time: 0.051578 May 13 13:29:27.967944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 408/797] 10.222.0.13 () {58 vars in 1412 bytes} [Fri May 13 13:29:27 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/os-volume_attachments/a1db76e0-c82c-42e2-ab47-b870c7f61eae => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:27.985356 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f897c5a9-a5ed-4ad3-9041-e0f9c839b799 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:27.986327 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f897c5a9-a5ed-4ad3-9041-e0f9c839b799 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:27.992634 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f897c5a9-a5ed-4ad3-9041-e0f9c839b799 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:27.993315 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f897c5a9-a5ed-4ad3-9041-e0f9c839b799 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:27.994107 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f897c5a9-a5ed-4ad3-9041-e0f9c839b799 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:27.995146 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f897c5a9-a5ed-4ad3-9041-e0f9c839b799 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:28.079480 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-f897c5a9-a5ed-4ad3-9041-e0f9c839b799 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lazy-loading 'services' on Instance uuid a2660342-b571-4b93-bef3-025664cd9ad6 {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:29:28.313413 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f897c5a9-a5ed-4ad3-9041-e0f9c839b799 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/os-volume_attachments/a1db76e0-c82c-42e2-ab47-b870c7f61eae" status: 202 len: 0 microversion: 2.1 time: 0.338966 May 13 13:29:28.314098 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 390/798] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 13 13:29:27 2022] DELETE /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/os-volume_attachments/a1db76e0-c82c-42e2-ab47-b870c7f61eae => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 13:29:28.852896 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ed21fa68-0de3-4786-96d5-98116a718ad7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:28.853459 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ed21fa68-0de3-4786-96d5-98116a718ad7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:28.860612 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ed21fa68-0de3-4786-96d5-98116a718ad7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:28.861050 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ed21fa68-0de3-4786-96d5-98116a718ad7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:28.861815 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ed21fa68-0de3-4786-96d5-98116a718ad7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:28.862282 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ed21fa68-0de3-4786-96d5-98116a718ad7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:29.000774 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ed21fa68-0de3-4786-96d5-98116a718ad7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:29.009103 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ed21fa68-0de3-4786-96d5-98116a718ad7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:29.010621 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ed21fa68-0de3-4786-96d5-98116a718ad7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:29.011797 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ed21fa68-0de3-4786-96d5-98116a718ad7 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1672 microversion: 2.20 time: 0.163491 May 13 13:29:29.012349 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 409/799] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:28 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:30.031404 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d2257f74-8065-4e20-acc6-625ef03136a3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:30.032416 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d2257f74-8065-4e20-acc6-625ef03136a3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:30.039013 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d2257f74-8065-4e20-acc6-625ef03136a3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:30.039464 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d2257f74-8065-4e20-acc6-625ef03136a3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:30.040250 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d2257f74-8065-4e20-acc6-625ef03136a3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:30.040692 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d2257f74-8065-4e20-acc6-625ef03136a3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:30.180315 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d2257f74-8065-4e20-acc6-625ef03136a3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:30.189437 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d2257f74-8065-4e20-acc6-625ef03136a3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:30.192134 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d2257f74-8065-4e20-acc6-625ef03136a3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:30.193328 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d2257f74-8065-4e20-acc6-625ef03136a3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1730 microversion: 2.20 time: 0.167049 May 13 13:29:30.194586 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 391/800] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:30 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:29:30.487154 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0124f87e-a44a-474a-9f38-aeb6c89d550e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:30.487782 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0124f87e-a44a-474a-9f38-aeb6c89d550e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:30.493644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0124f87e-a44a-474a-9f38-aeb6c89d550e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:30.494086 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0124f87e-a44a-474a-9f38-aeb6c89d550e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:30.494914 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0124f87e-a44a-474a-9f38-aeb6c89d550e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:30.495362 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0124f87e-a44a-474a-9f38-aeb6c89d550e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:30.527271 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0124f87e-a44a-474a-9f38-aeb6c89d550e tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/os-volume_attachments/6bdb0576-4ccd-4fa4-a1ff-8c1e2aeb8d5a" status: 200 len: 194 microversion: 2.1 time: 0.043953 May 13 13:29:30.528511 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 410/801] 10.222.0.13 () {58 vars in 1412 bytes} [Fri May 13 13:29:30 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/os-volume_attachments/6bdb0576-4ccd-4fa4-a1ff-8c1e2aeb8d5a => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:30.540410 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d07d6f99-17f4-497c-a297-2f0a9251cd9c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:30.540934 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d07d6f99-17f4-497c-a297-2f0a9251cd9c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:30.547276 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d07d6f99-17f4-497c-a297-2f0a9251cd9c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:30.547719 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d07d6f99-17f4-497c-a297-2f0a9251cd9c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:30.548499 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d07d6f99-17f4-497c-a297-2f0a9251cd9c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:30.548942 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d07d6f99-17f4-497c-a297-2f0a9251cd9c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:30.636338 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-d07d6f99-17f4-497c-a297-2f0a9251cd9c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lazy-loading 'services' on Instance uuid a2660342-b571-4b93-bef3-025664cd9ad6 {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:29:30.906487 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d07d6f99-17f4-497c-a297-2f0a9251cd9c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/os-volume_attachments/6bdb0576-4ccd-4fa4-a1ff-8c1e2aeb8d5a" status: 202 len: 0 microversion: 2.1 time: 0.371868 May 13 13:29:30.907157 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 392/802] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 13 13:29:30 2022] DELETE /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/os-volume_attachments/6bdb0576-4ccd-4fa4-a1ff-8c1e2aeb8d5a => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:29:31.213969 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7e8f38d0-b176-46f5-99b5-2360dc7f3135 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:31.214829 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7e8f38d0-b176-46f5-99b5-2360dc7f3135 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:31.221738 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7e8f38d0-b176-46f5-99b5-2360dc7f3135 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:31.222232 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7e8f38d0-b176-46f5-99b5-2360dc7f3135 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:31.225380 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7e8f38d0-b176-46f5-99b5-2360dc7f3135 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:31.225380 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7e8f38d0-b176-46f5-99b5-2360dc7f3135 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:31.372526 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7e8f38d0-b176-46f5-99b5-2360dc7f3135 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:31.381381 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7e8f38d0-b176-46f5-99b5-2360dc7f3135 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:31.382941 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7e8f38d0-b176-46f5-99b5-2360dc7f3135 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:31.384078 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7e8f38d0-b176-46f5-99b5-2360dc7f3135 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1730 microversion: 2.20 time: 0.174085 May 13 13:29:31.384631 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 411/803] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:31 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:32.404227 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-995aac70-51a3-4f9c-a831-7ae4d539741c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:32.405292 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-995aac70-51a3-4f9c-a831-7ae4d539741c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:32.413923 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-995aac70-51a3-4f9c-a831-7ae4d539741c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:32.414755 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-995aac70-51a3-4f9c-a831-7ae4d539741c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:32.422385 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-995aac70-51a3-4f9c-a831-7ae4d539741c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:32.422385 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-995aac70-51a3-4f9c-a831-7ae4d539741c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:32.558236 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-995aac70-51a3-4f9c-a831-7ae4d539741c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:32.567753 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-995aac70-51a3-4f9c-a831-7ae4d539741c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:32.569447 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-995aac70-51a3-4f9c-a831-7ae4d539741c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:32.571218 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-995aac70-51a3-4f9c-a831-7ae4d539741c tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1730 microversion: 2.20 time: 0.171604 May 13 13:29:32.571790 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 393/804] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:32 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:29:33.589876 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-aacecff2-dada-47b3-ae88-d00ada187758 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:33.592056 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-aacecff2-dada-47b3-ae88-d00ada187758 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:33.600108 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aacecff2-dada-47b3-ae88-d00ada187758 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:33.600456 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aacecff2-dada-47b3-ae88-d00ada187758 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:33.601278 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aacecff2-dada-47b3-ae88-d00ada187758 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:33.601775 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aacecff2-dada-47b3-ae88-d00ada187758 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:33.770348 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-aacecff2-dada-47b3-ae88-d00ada187758 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:33.779679 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-aacecff2-dada-47b3-ae88-d00ada187758 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:33.781348 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-aacecff2-dada-47b3-ae88-d00ada187758 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:33.782603 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-aacecff2-dada-47b3-ae88-d00ada187758 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1730 microversion: 2.20 time: 0.196780 May 13 13:29:33.783168 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 412/805] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:33 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:34.802627 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1b2e8463-2c8a-4a51-87f3-fc676d8ed7f3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:34.804347 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1b2e8463-2c8a-4a51-87f3-fc676d8ed7f3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:34.812490 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1b2e8463-2c8a-4a51-87f3-fc676d8ed7f3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:34.812935 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1b2e8463-2c8a-4a51-87f3-fc676d8ed7f3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:34.813926 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1b2e8463-2c8a-4a51-87f3-fc676d8ed7f3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:34.814386 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1b2e8463-2c8a-4a51-87f3-fc676d8ed7f3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:35.081263 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1b2e8463-2c8a-4a51-87f3-fc676d8ed7f3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:35.093428 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1b2e8463-2c8a-4a51-87f3-fc676d8ed7f3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:35.212441 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1b2e8463-2c8a-4a51-87f3-fc676d8ed7f3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:35.212441 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1b2e8463-2c8a-4a51-87f3-fc676d8ed7f3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1730 microversion: 2.20 time: 0.300009 May 13 13:29:35.212441 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 394/806] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:34 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1730 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:36.177460 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-288d705a-22a9-407e-a252-bc0818e64c36 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:36.178045 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-288d705a-22a9-407e-a252-bc0818e64c36 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:36.185385 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-288d705a-22a9-407e-a252-bc0818e64c36 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:36.190102 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-288d705a-22a9-407e-a252-bc0818e64c36 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:36.190102 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-288d705a-22a9-407e-a252-bc0818e64c36 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:36.190102 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-288d705a-22a9-407e-a252-bc0818e64c36 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:36.396639 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-288d705a-22a9-407e-a252-bc0818e64c36 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:36.406405 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-288d705a-22a9-407e-a252-bc0818e64c36 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:36.408161 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-288d705a-22a9-407e-a252-bc0818e64c36 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:36.409590 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-288d705a-22a9-407e-a252-bc0818e64c36 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1730 microversion: 2.20 time: 0.236289 May 13 13:29:36.421061 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 413/807] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:36 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1730 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:37.428832 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-811670b8-3f88-4364-99aa-ee0609c9ba46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:37.429450 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-811670b8-3f88-4364-99aa-ee0609c9ba46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:37.439615 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-811670b8-3f88-4364-99aa-ee0609c9ba46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:37.440030 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-811670b8-3f88-4364-99aa-ee0609c9ba46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:37.440825 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-811670b8-3f88-4364-99aa-ee0609c9ba46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:37.441289 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-811670b8-3f88-4364-99aa-ee0609c9ba46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:37.611433 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-811670b8-3f88-4364-99aa-ee0609c9ba46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:37.619811 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-811670b8-3f88-4364-99aa-ee0609c9ba46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:37.621875 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-811670b8-3f88-4364-99aa-ee0609c9ba46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:37.623334 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-811670b8-3f88-4364-99aa-ee0609c9ba46 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1730 microversion: 2.20 time: 0.198457 May 13 13:29:37.624234 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 395/808] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:37 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1730 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:38.643634 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-07d3fea2-9415-485f-a83c-5a6ee95e50e2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:38.645035 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-07d3fea2-9415-485f-a83c-5a6ee95e50e2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:38.651493 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-07d3fea2-9415-485f-a83c-5a6ee95e50e2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:38.651868 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-07d3fea2-9415-485f-a83c-5a6ee95e50e2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:38.653543 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-07d3fea2-9415-485f-a83c-5a6ee95e50e2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:38.653963 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-07d3fea2-9415-485f-a83c-5a6ee95e50e2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:38.823455 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-07d3fea2-9415-485f-a83c-5a6ee95e50e2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:38.839970 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-07d3fea2-9415-485f-a83c-5a6ee95e50e2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:38.842565 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-07d3fea2-9415-485f-a83c-5a6ee95e50e2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:38.843992 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-07d3fea2-9415-485f-a83c-5a6ee95e50e2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1730 microversion: 2.20 time: 0.204328 May 13 13:29:38.844645 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 414/809] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:38 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1730 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:39.865618 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-60a4d5f2-c410-4cbd-b8c8-e6daf6997e72 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:39.868610 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-60a4d5f2-c410-4cbd-b8c8-e6daf6997e72 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:39.873317 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-60a4d5f2-c410-4cbd-b8c8-e6daf6997e72 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:39.874026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-60a4d5f2-c410-4cbd-b8c8-e6daf6997e72 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:39.875237 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-60a4d5f2-c410-4cbd-b8c8-e6daf6997e72 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:39.876000 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-60a4d5f2-c410-4cbd-b8c8-e6daf6997e72 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:40.031988 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-60a4d5f2-c410-4cbd-b8c8-e6daf6997e72 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:40.039979 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-60a4d5f2-c410-4cbd-b8c8-e6daf6997e72 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:40.041474 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-60a4d5f2-c410-4cbd-b8c8-e6daf6997e72 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:40.042683 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-60a4d5f2-c410-4cbd-b8c8-e6daf6997e72 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1730 microversion: 2.20 time: 0.183523 May 13 13:29:40.043471 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 396/810] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:39 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:40.697474 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-65337433-500d-4183-afba-b5256804235d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:40.698440 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-65337433-500d-4183-afba-b5256804235d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:40.705985 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-65337433-500d-4183-afba-b5256804235d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:40.706456 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-65337433-500d-4183-afba-b5256804235d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:40.707256 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-65337433-500d-4183-afba-b5256804235d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:40.707697 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-65337433-500d-4183-afba-b5256804235d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:40.738971 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-65337433-500d-4183-afba-b5256804235d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045408 May 13 13:29:40.739532 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 415/811] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 13 13:29:40 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:41.062459 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f14fb92d-654d-459e-9528-53b75ff1c9d2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:41.063488 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f14fb92d-654d-459e-9528-53b75ff1c9d2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:41.070789 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f14fb92d-654d-459e-9528-53b75ff1c9d2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:41.071404 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f14fb92d-654d-459e-9528-53b75ff1c9d2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:41.072170 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f14fb92d-654d-459e-9528-53b75ff1c9d2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:41.072708 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f14fb92d-654d-459e-9528-53b75ff1c9d2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:41.217889 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f14fb92d-654d-459e-9528-53b75ff1c9d2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:41.226095 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f14fb92d-654d-459e-9528-53b75ff1c9d2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:41.227694 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f14fb92d-654d-459e-9528-53b75ff1c9d2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:41.229009 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f14fb92d-654d-459e-9528-53b75ff1c9d2 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1730 microversion: 2.20 time: 0.172056 May 13 13:29:41.229678 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 397/812] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:41 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:41.751375 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-87c646c4-cadc-4b7f-8e09-565d4aaf807d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:41.752223 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-87c646c4-cadc-4b7f-8e09-565d4aaf807d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:41.758733 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-87c646c4-cadc-4b7f-8e09-565d4aaf807d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:41.759177 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-87c646c4-cadc-4b7f-8e09-565d4aaf807d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:41.759955 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-87c646c4-cadc-4b7f-8e09-565d4aaf807d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:41.760392 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-87c646c4-cadc-4b7f-8e09-565d4aaf807d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:41.790058 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-87c646c4-cadc-4b7f-8e09-565d4aaf807d tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043981 May 13 13:29:41.790676 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 416/813] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 13 13:29:41 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 13:29:41.898907 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-cf5b3535-84bb-4af9-987b-35d832abac8a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:41.899902 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-cf5b3535-84bb-4af9-987b-35d832abac8a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:41.906959 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cf5b3535-84bb-4af9-987b-35d832abac8a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:41.907407 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cf5b3535-84bb-4af9-987b-35d832abac8a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:41.908175 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cf5b3535-84bb-4af9-987b-35d832abac8a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:41.908606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cf5b3535-84bb-4af9-987b-35d832abac8a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:41.937205 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-cf5b3535-84bb-4af9-987b-35d832abac8a tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042274 May 13 13:29:41.937764 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 398/814] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 13 13:29:41 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 13:29:41.994275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5cc8510d-105c-4b22-be19-915787f84b56 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:41.994766 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5cc8510d-105c-4b22-be19-915787f84b56 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:42.001079 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5cc8510d-105c-4b22-be19-915787f84b56 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:42.001575 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5cc8510d-105c-4b22-be19-915787f84b56 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:42.002297 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5cc8510d-105c-4b22-be19-915787f84b56 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:42.002917 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5cc8510d-105c-4b22-be19-915787f84b56 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:42.028737 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5cc8510d-105c-4b22-be19-915787f84b56 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Going to try to terminate instance {{(pid=117721) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:29:42.247582 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a2939f85-d4b6-41a8-91bf-39b91df89465 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:42.248196 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a2939f85-d4b6-41a8-91bf-39b91df89465 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:42.255140 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a2939f85-d4b6-41a8-91bf-39b91df89465 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:42.255517 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a2939f85-d4b6-41a8-91bf-39b91df89465 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:42.256301 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a2939f85-d4b6-41a8-91bf-39b91df89465 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:42.256740 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a2939f85-d4b6-41a8-91bf-39b91df89465 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:42.382406 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5cc8510d-105c-4b22-be19-915787f84b56 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6" status: 204 len: 0 microversion: 2.1 time: 0.391631 May 13 13:29:42.382982 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 417/815] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:29:41 2022] DELETE /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:29:42.392621 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c6c5d9e6-4a00-47d7-acbd-43c73e4568c1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:42.393326 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c6c5d9e6-4a00-47d7-acbd-43c73e4568c1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:42.399227 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c6c5d9e6-4a00-47d7-acbd-43c73e4568c1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:42.399686 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c6c5d9e6-4a00-47d7-acbd-43c73e4568c1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:42.400448 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c6c5d9e6-4a00-47d7-acbd-43c73e4568c1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:42.400874 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c6c5d9e6-4a00-47d7-acbd-43c73e4568c1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:42.405336 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a2939f85-d4b6-41a8-91bf-39b91df89465 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:42.414891 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a2939f85-d4b6-41a8-91bf-39b91df89465 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:42.416483 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a2939f85-d4b6-41a8-91bf-39b91df89465 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:42.417713 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a2939f85-d4b6-41a8-91bf-39b91df89465 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1730 microversion: 2.20 time: 0.174265 May 13 13:29:42.419234 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 399/816] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:42 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:29:42.556111 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c6c5d9e6-4a00-47d7-acbd-43c73e4568c1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:42.567980 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c6c5d9e6-4a00-47d7-acbd-43c73e4568c1 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6" status: 200 len: 1673 microversion: 2.1 time: 0.179964 May 13 13:29:42.568529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 418/817] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:29:42 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6 => generated 1673 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:43.437433 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-30824904-6813-4bff-9aec-9f3fa7a1f035 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:43.437999 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-30824904-6813-4bff-9aec-9f3fa7a1f035 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:43.444810 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-30824904-6813-4bff-9aec-9f3fa7a1f035 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:43.445252 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-30824904-6813-4bff-9aec-9f3fa7a1f035 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:43.446055 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-30824904-6813-4bff-9aec-9f3fa7a1f035 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:43.446512 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-30824904-6813-4bff-9aec-9f3fa7a1f035 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:43.585461 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-df126fe3-9b72-4843-a549-0559a835c798 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:43.586886 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-df126fe3-9b72-4843-a549-0559a835c798 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:43.594110 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df126fe3-9b72-4843-a549-0559a835c798 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:43.594905 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df126fe3-9b72-4843-a549-0559a835c798 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:43.595708 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df126fe3-9b72-4843-a549-0559a835c798 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:43.596148 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df126fe3-9b72-4843-a549-0559a835c798 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:43.607473 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-30824904-6813-4bff-9aec-9f3fa7a1f035 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:43.616217 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-30824904-6813-4bff-9aec-9f3fa7a1f035 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:43.617908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-30824904-6813-4bff-9aec-9f3fa7a1f035 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:43.619362 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-30824904-6813-4bff-9aec-9f3fa7a1f035 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1730 microversion: 2.20 time: 0.187002 May 13 13:29:43.627873 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 400/818] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:43 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:43.740688 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-df126fe3-9b72-4843-a549-0559a835c798 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:43.748967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-df126fe3-9b72-4843-a549-0559a835c798 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6" status: 200 len: 1673 microversion: 2.1 time: 0.167598 May 13 13:29:43.749539 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 419/819] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:29:43 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6 => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:44.639511 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-54534a65-e79d-4e94-b664-9deb83621f1a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:44.640104 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-54534a65-e79d-4e94-b664-9deb83621f1a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:44.646818 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-54534a65-e79d-4e94-b664-9deb83621f1a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:44.647362 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-54534a65-e79d-4e94-b664-9deb83621f1a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:44.648276 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-54534a65-e79d-4e94-b664-9deb83621f1a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:44.648947 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-54534a65-e79d-4e94-b664-9deb83621f1a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:44.768059 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d4908eeb-bfdb-4538-95ca-b6445d06b290 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:44.768836 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d4908eeb-bfdb-4538-95ca-b6445d06b290 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:44.779712 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d4908eeb-bfdb-4538-95ca-b6445d06b290 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:44.782353 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d4908eeb-bfdb-4538-95ca-b6445d06b290 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:44.782353 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d4908eeb-bfdb-4538-95ca-b6445d06b290 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:44.782634 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d4908eeb-bfdb-4538-95ca-b6445d06b290 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:44.792366 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-54534a65-e79d-4e94-b664-9deb83621f1a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:44.801577 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-54534a65-e79d-4e94-b664-9deb83621f1a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:44.815652 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-54534a65-e79d-4e94-b664-9deb83621f1a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:44.815652 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-54534a65-e79d-4e94-b664-9deb83621f1a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1730 microversion: 2.20 time: 0.169320 May 13 13:29:44.815652 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 401/820] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:44 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:29:44.935363 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d4908eeb-bfdb-4538-95ca-b6445d06b290 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:44.938010 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d4908eeb-bfdb-4538-95ca-b6445d06b290 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6" status: 200 len: 1673 microversion: 2.1 time: 0.173799 May 13 13:29:44.939073 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 420/821] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:29:44 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6 => generated 1673 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:45.207931 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-743f2cd4-2f03-4821-b5ca-23dc20960526 req-2ab8006f-c688-4183-be20-e3ca65ff947f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2660342-b571-4b93-bef3-025664cd9ad6", "name": "network-vif-deleted", "tag": "782846b6-0b62-4309-96f8-442c19de620e"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:45.217241 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-743f2cd4-2f03-4821-b5ca-23dc20960526 req-2ab8006f-c688-4183-be20-e3ca65ff947f service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:45.219426 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-743f2cd4-2f03-4821-b5ca-23dc20960526 req-2ab8006f-c688-4183-be20-e3ca65ff947f service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:45.239738 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-743f2cd4-2f03-4821-b5ca-23dc20960526 req-2ab8006f-c688-4183-be20-e3ca65ff947f service nova] Creating event network-vif-deleted:782846b6-0b62-4309-96f8-442c19de620e for instance a2660342-b571-4b93-bef3-025664cd9ad6 on hv-cinder-84163 May 13 13:29:45.242455 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-743f2cd4-2f03-4821-b5ca-23dc20960526 req-2ab8006f-c688-4183-be20-e3ca65ff947f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038055 May 13 13:29:45.243372 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 402/822] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:45.548039 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-04d7af22-6faf-4f9d-8ab8-2733cfb123a0 req-7e337cc3-6982-402d-a336-61d8b40b5f6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "274c20ca-135a-48d9-85e5-7c99cf77f68d", "name": "network-vif-plugged", "status": "completed", "tag": "729dc6f6-46b1-4dac-a320-fa9e54753c1c"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:45.565830 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-04d7af22-6faf-4f9d-8ab8-2733cfb123a0 req-7e337cc3-6982-402d-a336-61d8b40b5f6c service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:45.567238 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-04d7af22-6faf-4f9d-8ab8-2733cfb123a0 req-7e337cc3-6982-402d-a336-61d8b40b5f6c service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:45.585979 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-04d7af22-6faf-4f9d-8ab8-2733cfb123a0 req-7e337cc3-6982-402d-a336-61d8b40b5f6c service nova] Creating event network-vif-plugged:729dc6f6-46b1-4dac-a320-fa9e54753c1c for instance 274c20ca-135a-48d9-85e5-7c99cf77f68d on hv-cinder-84163 May 13 13:29:45.592233 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-04d7af22-6faf-4f9d-8ab8-2733cfb123a0 req-7e337cc3-6982-402d-a336-61d8b40b5f6c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049038 May 13 13:29:45.597925 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 421/823] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:45.829603 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6f0112c0-b025-456d-8857-f4b7b90bd21d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:45.830826 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6f0112c0-b025-456d-8857-f4b7b90bd21d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:45.842762 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6f0112c0-b025-456d-8857-f4b7b90bd21d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:45.844540 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6f0112c0-b025-456d-8857-f4b7b90bd21d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:45.845490 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6f0112c0-b025-456d-8857-f4b7b90bd21d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:45.845935 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6f0112c0-b025-456d-8857-f4b7b90bd21d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:45.962005 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f95b2d75-21b3-46e9-be9d-343c4ed0df2c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:45.962005 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f95b2d75-21b3-46e9-be9d-343c4ed0df2c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:45.972705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f95b2d75-21b3-46e9-be9d-343c4ed0df2c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:45.974261 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f95b2d75-21b3-46e9-be9d-343c4ed0df2c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:45.975341 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f95b2d75-21b3-46e9-be9d-343c4ed0df2c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:45.976689 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f95b2d75-21b3-46e9-be9d-343c4ed0df2c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:46.016842 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f95b2d75-21b3-46e9-be9d-343c4ed0df2c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:46.017717 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f95b2d75-21b3-46e9-be9d-343c4ed0df2c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:46.018406 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-f95b2d75-21b3-46e9-be9d-343c4ed0df2c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lazy-loading 'fault' on Instance uuid a2660342-b571-4b93-bef3-025664cd9ad6 {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:29:46.031756 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6f0112c0-b025-456d-8857-f4b7b90bd21d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:46.041251 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6f0112c0-b025-456d-8857-f4b7b90bd21d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:46.042827 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6f0112c0-b025-456d-8857-f4b7b90bd21d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:46.044570 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6f0112c0-b025-456d-8857-f4b7b90bd21d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1730 microversion: 2.20 time: 0.224068 May 13 13:29:46.045846 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 403/824] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:45 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1730 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:46.078508 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f95b2d75-21b3-46e9-be9d-343c4ed0df2c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9e2d9bbf294793a494709efde09b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c22198af7e14553a967643df90e501f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:46.086193 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f95b2d75-21b3-46e9-be9d-343c4ed0df2c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6" status: 200 len: 1327 microversion: 2.1 time: 0.133053 May 13 13:29:46.087145 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 422/825] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:29:45 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6 => generated 1327 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:47.063071 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-cb3b4062-b8d1-45de-b8bb-6c3a9653cc7e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:47.063665 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-cb3b4062-b8d1-45de-b8bb-6c3a9653cc7e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:47.070163 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cb3b4062-b8d1-45de-b8bb-6c3a9653cc7e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:47.070644 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cb3b4062-b8d1-45de-b8bb-6c3a9653cc7e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:47.071416 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cb3b4062-b8d1-45de-b8bb-6c3a9653cc7e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:47.071848 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cb3b4062-b8d1-45de-b8bb-6c3a9653cc7e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:47.107603 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2f8e83a1-57d7-427b-a704-f742aa5c5ae3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:47.108208 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2f8e83a1-57d7-427b-a704-f742aa5c5ae3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:47.114833 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2f8e83a1-57d7-427b-a704-f742aa5c5ae3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:47.122190 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2f8e83a1-57d7-427b-a704-f742aa5c5ae3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:47.122190 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2f8e83a1-57d7-427b-a704-f742aa5c5ae3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:47.122190 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2f8e83a1-57d7-427b-a704-f742aa5c5ae3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:47.135367 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-2f8e83a1-57d7-427b-a704-f742aa5c5ae3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] HTTP exception thrown: Instance a2660342-b571-4b93-bef3-025664cd9ad6 could not be found. May 13 13:29:47.138068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2f8e83a1-57d7-427b-a704-f742aa5c5ae3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Request method failure captured: May 13 13:29:47.138068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6 HTTP/1.1 May 13 13:29:47.138068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:29:47.138068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:29:47.138068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:29:47.138068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:29:47.138068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:29:47.138068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:29:47.138068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:29:47.138068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:29:47.138068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiflu_zHiDTPcgHev98jjKim4ikKsTwGUqkbSArV9_vg5rBUOnz9koE-ckeKuMG7_RRtuGWaHd2FJQfQqoEi8shYdlY3_cEzAJ1Pq1Wckt1SfbouazpWm-uvBx1I86FyxdYyd853RN2GT4weMNRJ--mwwqMbERy2QQw3xGT4ba7yvpXfs May 13 13:29:47.138068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:29:47.138068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:29:47.138068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:29:47.138068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:29:47.138068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:29:47.138068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:29:47.138068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: 6c22198af7e14553a967643df90e501f May 13 13:29:47.138068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeTestJSON-962224307 May 13 13:29:47.138068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:29:47.138068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:29:47.139807 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6c22198af7e14553a967643df90e501f", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6c22198af7e14553a967643df90e501f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6c22198af7e14553a967643df90e501f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6c22198af7e14553a967643df90e501f"}]}] May 13 13:29:47.139807 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeTestJSON-962224307 May 13 13:29:47.139807 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 6c22198af7e14553a967643df90e501f May 13 13:29:47.139807 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeTestJSON-962224307 May 13 13:29:47.139807 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeTestJSON-962224307-project May 13 13:29:47.139807 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:29:47.139807 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:29:47.139807 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: ba9e2d9bbf294793a494709efde09b83 May 13 13:29:47.139807 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeTestJSON-962224307-project May 13 13:29:47.139807 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: > May 13 13:29:47.139807 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Instance a2660342-b571-4b93-bef3-025664cd9ad6 could not be found. May 13 13:29:47.139807 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': 'a2660342-b571-4b93-bef3-025664cd9ad6'} May 13 13:29:47.140661 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:29:47.140661 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:29:47.140661 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:29:47.140661 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:29:47.140661 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:29:47.140661 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:29:47.140661 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:29:47.140661 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:29:47.140661 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:29:47.140661 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:29:47.140661 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2660342-b571-4b93-bef3-025664cd9ad6 could not be found. May 13 13:29:47.140661 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:29:47.140661 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:29:47.140661 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:29:47.140661 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:29:47.140661 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:29:47.140661 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:29:47.140661 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:29:47.140661 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:29:47.140661 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:29:47.141905 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:29:47.141905 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:29:47.141905 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:29:47.141905 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:29:47.141905 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:29:47.141905 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:29:47.141905 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:29:47.141905 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2660342-b571-4b93-bef3-025664cd9ad6 could not be found. May 13 13:29:47.141905 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:29:47.141905 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:29:47.141905 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:29:47.141905 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:29:47.141905 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:29:47.141905 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:29:47.141905 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:29:47.141905 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:29:47.141905 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2660342-b571-4b93-bef3-025664cd9ad6 could not be found. May 13 13:29:47.141905 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:29:47.143029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2f8e83a1-57d7-427b-a704-f742aa5c5ae3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Returning 404 to user: Instance a2660342-b571-4b93-bef3-025664cd9ad6 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:29:47.143029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2f8e83a1-57d7-427b-a704-f742aa5c5ae3 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6" status: 404 len: 111 microversion: 2.1 time: 0.035631 May 13 13:29:47.143029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 423/826] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:29:47 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 13:29:47.149030 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e18bef6c-71eb-41a6-b3c2-db6ccef91ed2 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '.version_select at 0x7fb089481310>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:47.230421 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-cb3b4062-b8d1-45de-b8bb-6c3a9653cc7e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:47.238528 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-cb3b4062-b8d1-45de-b8bb-6c3a9653cc7e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:47.240063 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-cb3b4062-b8d1-45de-b8bb-6c3a9653cc7e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:47.241292 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-cb3b4062-b8d1-45de-b8bb-6c3a9653cc7e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1730 microversion: 2.20 time: 0.182403 May 13 13:29:47.241864 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 404/827] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:47 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:47.254398 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e18bef6c-71eb-41a6-b3c2-db6ccef91ed2 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-927254874" status: 202 len: 0 microversion: 2.1 time: 0.109140 May 13 13:29:47.255111 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 424/828] 10.222.0.13 () {58 vars in 1217 bytes} [Fri May 13 13:29:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-927254874 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:29:48.263610 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-bb0b1147-d908-4588-a30c-f61cc46a1dda tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:48.264237 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-bb0b1147-d908-4588-a30c-f61cc46a1dda tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:48.275531 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bb0b1147-d908-4588-a30c-f61cc46a1dda tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:48.275531 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bb0b1147-d908-4588-a30c-f61cc46a1dda tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:48.275531 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bb0b1147-d908-4588-a30c-f61cc46a1dda tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:48.275531 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bb0b1147-d908-4588-a30c-f61cc46a1dda tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:48.460305 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-bb0b1147-d908-4588-a30c-f61cc46a1dda tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:48.469342 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-bb0b1147-d908-4588-a30c-f61cc46a1dda tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:48.471030 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-bb0b1147-d908-4588-a30c-f61cc46a1dda tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:48.472187 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-bb0b1147-d908-4588-a30c-f61cc46a1dda tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1730 microversion: 2.20 time: 0.215093 May 13 13:29:48.472952 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 405/829] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:48 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1730 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:49.492513 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5c162df6-0e38-4772-b266-0093acd3bf41 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:49.493902 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5c162df6-0e38-4772-b266-0093acd3bf41 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:49.501597 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5c162df6-0e38-4772-b266-0093acd3bf41 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:49.502040 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5c162df6-0e38-4772-b266-0093acd3bf41 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:49.505423 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5c162df6-0e38-4772-b266-0093acd3bf41 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:49.505423 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5c162df6-0e38-4772-b266-0093acd3bf41 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:49.641995 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5c162df6-0e38-4772-b266-0093acd3bf41 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:49.650110 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5c162df6-0e38-4772-b266-0093acd3bf41 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:49.651789 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5c162df6-0e38-4772-b266-0093acd3bf41 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:49.652963 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5c162df6-0e38-4772-b266-0093acd3bf41 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1717 microversion: 2.20 time: 0.165150 May 13 13:29:49.653718 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 425/830] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:29:49 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1717 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:50.780634 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-71f03c46-3b62-48f2-9f66-e3e494a3c356 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:50.781200 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-71f03c46-3b62-48f2-9f66-e3e494a3c356 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:50.787861 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-71f03c46-3b62-48f2-9f66-e3e494a3c356 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:50.790662 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-71f03c46-3b62-48f2-9f66-e3e494a3c356 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:50.790662 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-71f03c46-3b62-48f2-9f66-e3e494a3c356 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:50.790662 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-71f03c46-3b62-48f2-9f66-e3e494a3c356 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:50.805821 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-71f03c46-3b62-48f2-9f66-e3e494a3c356 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] HTTP exception thrown: Instance a2660342-b571-4b93-bef3-025664cd9ad6 could not be found. May 13 13:29:50.807507 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-71f03c46-3b62-48f2-9f66-e3e494a3c356 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Request method failure captured: May 13 13:29:50.807507 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: request: DELETE /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6 HTTP/1.1 May 13 13:29:50.807507 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept: application/json May 13 13:29:50.807507 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity May 13 13:29:50.807507 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Connection: close May 13 13:29:50.807507 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Length: 0 May 13 13:29:50.807507 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Type: application/json May 13 13:29:50.807507 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Host: 10.222.0.13 May 13 13:29:50.807507 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None May 13 13:29:50.807507 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 May 13 13:29:50.807507 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiflu_zHiDTPcgHev98jjKim4ikKsTwGUqkbSArV9_vg5rBUOnz9koE-ckeKuMG7_RRtuGWaHd2FJQfQqoEi8shYdlY3_cEzAJ1Pq1Wckt1SfbouazpWm-uvBx1I86FyxdYyd853RN2GT4weMNRJ--mwwqMbERy2QQw3xGT4ba7yvpXfs May 13 13:29:50.807507 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Id: None May 13 13:29:50.807507 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Name: None May 13 13:29:50.807507 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed May 13 13:29:50.807507 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True May 13 13:29:50.807507 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default May 13 13:29:50.807507 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default May 13 13:29:50.807507 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Id: 6c22198af7e14553a967643df90e501f May 13 13:29:50.807507 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-AttachVolumeTestJSON-962224307 May 13 13:29:50.807507 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Role: member,reader May 13 13:29:50.807507 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Roles: member,reader May 13 13:29:50.810723 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6c22198af7e14553a967643df90e501f", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6c22198af7e14553a967643df90e501f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6c22198af7e14553a967643df90e501f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6c22198af7e14553a967643df90e501f"}]}] May 13 13:29:50.810723 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-AttachVolumeTestJSON-962224307 May 13 13:29:50.810723 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 6c22198af7e14553a967643df90e501f May 13 13:29:50.810723 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-AttachVolumeTestJSON-962224307 May 13 13:29:50.810723 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User: tempest-AttachVolumeTestJSON-962224307-project May 13 13:29:50.810723 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default May 13 13:29:50.810723 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default May 13 13:29:50.810723 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Id: ba9e2d9bbf294793a494709efde09b83 May 13 13:29:50.810723 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-AttachVolumeTestJSON-962224307-project May 13 13:29:50.810723 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: method: > May 13 13:29:50.810723 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: exception: Instance a2660342-b571-4b93-bef3-025664cd9ad6 could not be found. May 13 13:29:50.810723 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: action_args: {'id': 'a2660342-b571-4b93-bef3-025664cd9ad6'} May 13 13:29:50.812501 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:29:50.812501 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:29:50.812501 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:29:50.812501 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:29:50.812501 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:29:50.812501 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:29:50.812501 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:29:50.812501 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:29:50.812501 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:29:50.812501 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:29:50.812501 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2660342-b571-4b93-bef3-025664cd9ad6 could not be found. May 13 13:29:50.812501 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:29:50.812501 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:29:50.812501 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:29:50.812501 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:29:50.812501 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:29:50.812501 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:29:50.812501 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:29:50.812501 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:29:50.812501 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:29:50.819602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:29:50.819602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:29:50.819602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:29:50.819602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:29:50.819602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:29:50.819602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:29:50.819602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:29:50.819602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:29:50.819602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:29:50.819602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2660342-b571-4b93-bef3-025664cd9ad6 could not be found. May 13 13:29:50.819602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:29:50.819602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:29:50.819602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:29:50.819602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:29:50.819602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:29:50.819602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:29:50.819602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:29:50.819602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:29:50.819602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2660342-b571-4b93-bef3-025664cd9ad6 could not be found. May 13 13:29:50.819602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:29:50.821116 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-71f03c46-3b62-48f2-9f66-e3e494a3c356 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Returning 404 to user: Instance a2660342-b571-4b93-bef3-025664cd9ad6 could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:29:50.821116 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-71f03c46-3b62-48f2-9f66-e3e494a3c356 tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6" status: 404 len: 111 microversion: 2.1 time: 0.032352 May 13 13:29:50.821116 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 406/831] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:29:50 2022] DELETE /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:29:50.821394 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-bfa03f18-fded-4ceb-9c70-313556bf918c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:50.821394 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-bfa03f18-fded-4ceb-9c70-313556bf918c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: a2660342-b571-4b93-bef3-025664cd9ad6] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:50.828510 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bfa03f18-fded-4ceb-9c70-313556bf918c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:50.828959 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bfa03f18-fded-4ceb-9c70-313556bf918c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:50.829735 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bfa03f18-fded-4ceb-9c70-313556bf918c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:50.830169 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bfa03f18-fded-4ceb-9c70-313556bf918c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:50.844811 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-bfa03f18-fded-4ceb-9c70-313556bf918c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] HTTP exception thrown: Instance a2660342-b571-4b93-bef3-025664cd9ad6 could not be found. May 13 13:29:50.846384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-bfa03f18-fded-4ceb-9c70-313556bf918c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Request method failure captured: May 13 13:29:50.846384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6 HTTP/1.1 May 13 13:29:50.846384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:29:50.846384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:29:50.846384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:29:50.846384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:29:50.846384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:29:50.846384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:29:50.846384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:29:50.846384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:29:50.846384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiflu_zHiDTPcgHev98jjKim4ikKsTwGUqkbSArV9_vg5rBUOnz9koE-ckeKuMG7_RRtuGWaHd2FJQfQqoEi8shYdlY3_cEzAJ1Pq1Wckt1SfbouazpWm-uvBx1I86FyxdYyd853RN2GT4weMNRJ--mwwqMbERy2QQw3xGT4ba7yvpXfs May 13 13:29:50.846384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:29:50.846384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:29:50.846384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:29:50.846384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:29:50.846384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:29:50.846384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:29:50.846384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: 6c22198af7e14553a967643df90e501f May 13 13:29:50.846384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeTestJSON-962224307 May 13 13:29:50.846384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:29:50.846384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:29:50.847951 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6c22198af7e14553a967643df90e501f", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6c22198af7e14553a967643df90e501f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6c22198af7e14553a967643df90e501f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6c22198af7e14553a967643df90e501f"}]}] May 13 13:29:50.847951 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeTestJSON-962224307 May 13 13:29:50.847951 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 6c22198af7e14553a967643df90e501f May 13 13:29:50.847951 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeTestJSON-962224307 May 13 13:29:50.847951 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeTestJSON-962224307-project May 13 13:29:50.847951 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:29:50.847951 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:29:50.847951 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: ba9e2d9bbf294793a494709efde09b83 May 13 13:29:50.847951 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeTestJSON-962224307-project May 13 13:29:50.847951 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: > May 13 13:29:50.847951 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Instance a2660342-b571-4b93-bef3-025664cd9ad6 could not be found. May 13 13:29:50.847951 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': 'a2660342-b571-4b93-bef3-025664cd9ad6'} May 13 13:29:50.848758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:29:50.848758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:29:50.848758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:29:50.848758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:29:50.848758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:29:50.848758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:29:50.848758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:29:50.848758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:29:50.848758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:29:50.848758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:29:50.848758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2660342-b571-4b93-bef3-025664cd9ad6 could not be found. May 13 13:29:50.848758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:29:50.848758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:29:50.848758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:29:50.848758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:29:50.848758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:29:50.848758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:29:50.848758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:29:50.848758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:29:50.848758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:29:50.849944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:29:50.849944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:29:50.849944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:29:50.849944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:29:50.849944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:29:50.849944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:29:50.849944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:29:50.849944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2660342-b571-4b93-bef3-025664cd9ad6 could not be found. May 13 13:29:50.849944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:29:50.849944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:29:50.849944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:29:50.849944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:29:50.849944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:29:50.849944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:29:50.849944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:29:50.849944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:29:50.849944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2660342-b571-4b93-bef3-025664cd9ad6 could not be found. May 13 13:29:50.849944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:29:50.851064 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-bfa03f18-fded-4ceb-9c70-313556bf918c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Returning 404 to user: Instance a2660342-b571-4b93-bef3-025664cd9ad6 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:29:50.851064 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-bfa03f18-fded-4ceb-9c70-313556bf918c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6" status: 404 len: 111 microversion: 2.1 time: 0.031867 May 13 13:29:50.851064 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 426/832] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:29:50 2022] GET /compute/v2.1/servers/a2660342-b571-4b93-bef3-025664cd9ad6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:29:52.151170 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-23faf535-ca9a-46a3-a1cf-31573400582c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:52.151782 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-23faf535-ca9a-46a3-a1cf-31573400582c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:52.158156 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-23faf535-ca9a-46a3-a1cf-31573400582c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:52.158596 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-23faf535-ca9a-46a3-a1cf-31573400582c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:52.159358 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-23faf535-ca9a-46a3-a1cf-31573400582c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:52.159785 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-23faf535-ca9a-46a3-a1cf-31573400582c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:52.174302 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-23faf535-ca9a-46a3-a1cf-31573400582c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] HTTP exception thrown: Instance 3b2c2709-a695-4f16-a0fa-fed674cfab86 could not be found. May 13 13:29:52.175844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-23faf535-ca9a-46a3-a1cf-31573400582c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Request method failure captured: May 13 13:29:52.175844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: request: DELETE /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 HTTP/1.1 May 13 13:29:52.175844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept: application/json May 13 13:29:52.175844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity May 13 13:29:52.175844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Connection: close May 13 13:29:52.175844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Length: 0 May 13 13:29:52.175844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Type: application/json May 13 13:29:52.175844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Host: 10.222.0.13 May 13 13:29:52.175844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None May 13 13:29:52.175844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 May 13 13:29:52.175844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiflu_zHiDTPcgHev98jjKim4ikKsTwGUqkbSArV9_vg5rBUOnz9koE-ckeKuMG7_RRtuGWaHd2FJQfQqoEi8shYdlY3_cEzAJ1Pq1Wckt1SfbouazpWm-uvBx1I86FyxdYyd853RN2GT4weMNRJ--mwwqMbERy2QQw3xGT4ba7yvpXfs May 13 13:29:52.175844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Id: None May 13 13:29:52.175844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Name: None May 13 13:29:52.175844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed May 13 13:29:52.175844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True May 13 13:29:52.175844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default May 13 13:29:52.175844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default May 13 13:29:52.175844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Id: 6c22198af7e14553a967643df90e501f May 13 13:29:52.175844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-AttachVolumeTestJSON-962224307 May 13 13:29:52.175844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Role: member,reader May 13 13:29:52.175844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Roles: member,reader May 13 13:29:52.177478 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6c22198af7e14553a967643df90e501f", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6c22198af7e14553a967643df90e501f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6c22198af7e14553a967643df90e501f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6c22198af7e14553a967643df90e501f"}]}] May 13 13:29:52.177478 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-AttachVolumeTestJSON-962224307 May 13 13:29:52.177478 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 6c22198af7e14553a967643df90e501f May 13 13:29:52.177478 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-AttachVolumeTestJSON-962224307 May 13 13:29:52.177478 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User: tempest-AttachVolumeTestJSON-962224307-project May 13 13:29:52.177478 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default May 13 13:29:52.177478 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default May 13 13:29:52.177478 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Id: ba9e2d9bbf294793a494709efde09b83 May 13 13:29:52.177478 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-AttachVolumeTestJSON-962224307-project May 13 13:29:52.177478 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: method: > May 13 13:29:52.177478 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: exception: Instance 3b2c2709-a695-4f16-a0fa-fed674cfab86 could not be found. May 13 13:29:52.177478 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: action_args: {'id': '3b2c2709-a695-4f16-a0fa-fed674cfab86'} May 13 13:29:52.178435 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:29:52.178435 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:29:52.178435 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:29:52.178435 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:29:52.178435 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:29:52.178435 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:29:52.178435 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:29:52.178435 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:29:52.178435 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:29:52.178435 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:29:52.178435 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b2c2709-a695-4f16-a0fa-fed674cfab86 could not be found. May 13 13:29:52.178435 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:29:52.178435 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:29:52.178435 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:29:52.178435 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:29:52.178435 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:29:52.178435 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:29:52.178435 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:29:52.178435 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:29:52.178435 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:29:52.180103 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:29:52.180103 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:29:52.180103 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:29:52.180103 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:29:52.180103 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:29:52.180103 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:29:52.180103 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:29:52.180103 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:29:52.180103 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:29:52.180103 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b2c2709-a695-4f16-a0fa-fed674cfab86 could not be found. May 13 13:29:52.180103 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:29:52.180103 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:29:52.180103 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:29:52.180103 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:29:52.180103 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:29:52.180103 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:29:52.180103 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:29:52.180103 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:29:52.180103 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b2c2709-a695-4f16-a0fa-fed674cfab86 could not be found. May 13 13:29:52.180103 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:29:52.181556 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-23faf535-ca9a-46a3-a1cf-31573400582c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Returning 404 to user: Instance 3b2c2709-a695-4f16-a0fa-fed674cfab86 could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:29:52.181556 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-23faf535-ca9a-46a3-a1cf-31573400582c tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 404 len: 111 microversion: 2.1 time: 0.029882 May 13 13:29:52.181556 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 407/833] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:29:52 2022] DELETE /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:29:52.192232 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cd235b55-b3a8-4bd7-8a35-15efbdb509bf tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:52.192996 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-cd235b55-b3a8-4bd7-8a35-15efbdb509bf tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] [instance: 3b2c2709-a695-4f16-a0fa-fed674cfab86] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:52.200014 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cd235b55-b3a8-4bd7-8a35-15efbdb509bf tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:52.200463 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cd235b55-b3a8-4bd7-8a35-15efbdb509bf tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:52.201892 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cd235b55-b3a8-4bd7-8a35-15efbdb509bf tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:52.202964 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cd235b55-b3a8-4bd7-8a35-15efbdb509bf tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:52.217268 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-cd235b55-b3a8-4bd7-8a35-15efbdb509bf tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] HTTP exception thrown: Instance 3b2c2709-a695-4f16-a0fa-fed674cfab86 could not be found. May 13 13:29:52.218751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cd235b55-b3a8-4bd7-8a35-15efbdb509bf tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Request method failure captured: May 13 13:29:52.218751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 HTTP/1.1 May 13 13:29:52.218751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:29:52.218751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:29:52.218751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:29:52.218751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:29:52.218751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:29:52.218751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:29:52.218751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:29:52.218751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:29:52.218751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiflu_zHiDTPcgHev98jjKim4ikKsTwGUqkbSArV9_vg5rBUOnz9koE-ckeKuMG7_RRtuGWaHd2FJQfQqoEi8shYdlY3_cEzAJ1Pq1Wckt1SfbouazpWm-uvBx1I86FyxdYyd853RN2GT4weMNRJ--mwwqMbERy2QQw3xGT4ba7yvpXfs May 13 13:29:52.218751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:29:52.218751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:29:52.218751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:29:52.218751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:29:52.218751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:29:52.218751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:29:52.218751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: 6c22198af7e14553a967643df90e501f May 13 13:29:52.218751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeTestJSON-962224307 May 13 13:29:52.218751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:29:52.218751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:29:52.220648 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6c22198af7e14553a967643df90e501f", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6c22198af7e14553a967643df90e501f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6c22198af7e14553a967643df90e501f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6c22198af7e14553a967643df90e501f"}]}] May 13 13:29:52.220648 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeTestJSON-962224307 May 13 13:29:52.220648 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 6c22198af7e14553a967643df90e501f May 13 13:29:52.220648 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeTestJSON-962224307 May 13 13:29:52.220648 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeTestJSON-962224307-project May 13 13:29:52.220648 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:29:52.220648 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:29:52.220648 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: ba9e2d9bbf294793a494709efde09b83 May 13 13:29:52.220648 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeTestJSON-962224307-project May 13 13:29:52.220648 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: > May 13 13:29:52.220648 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Instance 3b2c2709-a695-4f16-a0fa-fed674cfab86 could not be found. May 13 13:29:52.220648 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': '3b2c2709-a695-4f16-a0fa-fed674cfab86'} May 13 13:29:52.221480 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:29:52.221480 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:29:52.221480 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:29:52.221480 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:29:52.221480 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:29:52.221480 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:29:52.221480 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:29:52.221480 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:29:52.221480 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:29:52.221480 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:29:52.221480 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b2c2709-a695-4f16-a0fa-fed674cfab86 could not be found. May 13 13:29:52.221480 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:29:52.221480 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:29:52.221480 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:29:52.221480 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:29:52.221480 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:29:52.221480 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:29:52.221480 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:29:52.221480 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:29:52.221480 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:29:52.222835 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:29:52.222835 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:29:52.222835 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:29:52.222835 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:29:52.222835 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:29:52.222835 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:29:52.222835 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:29:52.222835 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b2c2709-a695-4f16-a0fa-fed674cfab86 could not be found. May 13 13:29:52.222835 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:29:52.222835 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:29:52.222835 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:29:52.222835 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:29:52.222835 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:29:52.222835 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:29:52.222835 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:29:52.222835 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:29:52.222835 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b2c2709-a695-4f16-a0fa-fed674cfab86 could not be found. May 13 13:29:52.222835 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:29:52.223934 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cd235b55-b3a8-4bd7-8a35-15efbdb509bf tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] Returning 404 to user: Instance 3b2c2709-a695-4f16-a0fa-fed674cfab86 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:29:52.223934 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-cd235b55-b3a8-4bd7-8a35-15efbdb509bf tempest-AttachVolumeTestJSON-962224307 tempest-AttachVolumeTestJSON-962224307-project] 10.222.0.13 "GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86" status: 404 len: 111 microversion: 2.1 time: 0.032211 May 13 13:29:52.223934 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 427/834] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:29:52 2022] GET /compute/v2.1/servers/3b2c2709-a695-4f16-a0fa-fed674cfab86 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:30:03.919995 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-260e4280-f639-4a49-8154-ba8d4c2feac3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:03.920550 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-260e4280-f639-4a49-8154-ba8d4c2feac3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:03.927073 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-260e4280-f639-4a49-8154-ba8d4c2feac3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:03.927515 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-260e4280-f639-4a49-8154-ba8d4c2feac3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:03.928290 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-260e4280-f639-4a49-8154-ba8d4c2feac3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:03.928723 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-260e4280-f639-4a49-8154-ba8d4c2feac3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:03.953362 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-260e4280-f639-4a49-8154-ba8d4c2feac3 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337/ips" status: 200 len: 148 microversion: 2.1 time: 0.039940 May 13 13:30:03.958516 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 408/835] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 13 13:30:03 2022] GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337/ips => generated 148 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:30:05.610722 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2c02a957-67b2-4da0-8958-7a7de94f5528 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5cd9f6f4-5c76-45ff-96e9-7027612e2171"}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:30:05.611844 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2c02a957-67b2-4da0-8958-7a7de94f5528 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:05.618338 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2c02a957-67b2-4da0-8958-7a7de94f5528 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:05.618784 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2c02a957-67b2-4da0-8958-7a7de94f5528 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:05.619557 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2c02a957-67b2-4da0-8958-7a7de94f5528 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:05.619990 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2c02a957-67b2-4da0-8958-7a7de94f5528 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:06.710293 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2c02a957-67b2-4da0-8958-7a7de94f5528 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "POST /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.103762 May 13 13:30:06.711668 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 428/836] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 13 13:30:05 2022] POST /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337/os-volume_attachments => generated 194 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:30:16.615613 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0cf13dd7-b28b-410c-aa58-74628ca9eb41 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:16.616250 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0cf13dd7-b28b-410c-aa58-74628ca9eb41 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:16.622145 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0cf13dd7-b28b-410c-aa58-74628ca9eb41 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:16.622620 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0cf13dd7-b28b-410c-aa58-74628ca9eb41 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:16.623492 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0cf13dd7-b28b-410c-aa58-74628ca9eb41 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:16.623927 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0cf13dd7-b28b-410c-aa58-74628ca9eb41 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:16.708033 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-0cf13dd7-b28b-410c-aa58-74628ca9eb41 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lazy-loading 'services' on Instance uuid 835a8273-f466-42d9-818d-17b347b44337 {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:30:16.942961 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0cf13dd7-b28b-410c-aa58-74628ca9eb41 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "DELETE /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337/os-volume_attachments/5cd9f6f4-5c76-45ff-96e9-7027612e2171" status: 202 len: 0 microversion: 2.1 time: 0.333348 May 13 13:30:16.943558 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 409/837] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 13 13:30:16 2022] DELETE /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337/os-volume_attachments/5cd9f6f4-5c76-45ff-96e9-7027612e2171 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:30:16.953985 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-40b30220-5b4f-4d43-aa40-7aa6b7f57545 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:16.956587 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-40b30220-5b4f-4d43-aa40-7aa6b7f57545 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:16.963014 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-40b30220-5b4f-4d43-aa40-7aa6b7f57545 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:16.963458 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-40b30220-5b4f-4d43-aa40-7aa6b7f57545 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:16.964232 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-40b30220-5b4f-4d43-aa40-7aa6b7f57545 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:16.964675 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-40b30220-5b4f-4d43-aa40-7aa6b7f57545 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:17.002522 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-40b30220-5b4f-4d43-aa40-7aa6b7f57545 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054198 May 13 13:30:17.003137 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 429/838] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 13 13:30:16 2022] GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:30:18.022863 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ea694da8-9cd3-4410-a136-65ea5cc4d8af tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:18.023871 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ea694da8-9cd3-4410-a136-65ea5cc4d8af tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:18.035227 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ea694da8-9cd3-4410-a136-65ea5cc4d8af tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:18.035227 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ea694da8-9cd3-4410-a136-65ea5cc4d8af tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:18.035227 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ea694da8-9cd3-4410-a136-65ea5cc4d8af tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:18.035227 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ea694da8-9cd3-4410-a136-65ea5cc4d8af tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:18.074882 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ea694da8-9cd3-4410-a136-65ea5cc4d8af tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056882 May 13 13:30:18.075458 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 410/839] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 13 13:30:18 2022] GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 13:30:18.137639 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-247208b6-09b5-4270-9cc0-d6e9664755c2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:18.138292 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-247208b6-09b5-4270-9cc0-d6e9664755c2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:18.145723 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-247208b6-09b5-4270-9cc0-d6e9664755c2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:18.146392 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-247208b6-09b5-4270-9cc0-d6e9664755c2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:18.147206 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-247208b6-09b5-4270-9cc0-d6e9664755c2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:18.147661 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-247208b6-09b5-4270-9cc0-d6e9664755c2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:18.175100 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-247208b6-09b5-4270-9cc0-d6e9664755c2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Going to try to terminate instance {{(pid=117721) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:30:18.496369 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-247208b6-09b5-4270-9cc0-d6e9664755c2 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "DELETE /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337" status: 204 len: 0 microversion: 2.1 time: 0.363294 May 13 13:30:18.497033 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 430/840] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:30:18 2022] DELETE /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:30:18.505638 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-dd673bac-6e51-48c5-8ef4-2204e317f786 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:18.506263 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-dd673bac-6e51-48c5-8ef4-2204e317f786 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:18.512096 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dd673bac-6e51-48c5-8ef4-2204e317f786 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:18.512537 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dd673bac-6e51-48c5-8ef4-2204e317f786 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:18.513288 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dd673bac-6e51-48c5-8ef4-2204e317f786 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:18.514649 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dd673bac-6e51-48c5-8ef4-2204e317f786 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:18.661409 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dd673bac-6e51-48c5-8ef4-2204e317f786 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:18.669337 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-dd673bac-6e51-48c5-8ef4-2204e317f786 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337" status: 200 len: 1678 microversion: 2.1 time: 0.167425 May 13 13:30:18.671121 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 411/841] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:18 2022] GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:19.689575 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-48aadaec-e712-4c56-b3fe-2c6d23d5c1a4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:19.690359 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-48aadaec-e712-4c56-b3fe-2c6d23d5c1a4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:19.697485 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-48aadaec-e712-4c56-b3fe-2c6d23d5c1a4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:19.697931 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-48aadaec-e712-4c56-b3fe-2c6d23d5c1a4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:19.698834 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-48aadaec-e712-4c56-b3fe-2c6d23d5c1a4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:19.699264 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-48aadaec-e712-4c56-b3fe-2c6d23d5c1a4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:19.836158 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-48aadaec-e712-4c56-b3fe-2c6d23d5c1a4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:19.846495 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-48aadaec-e712-4c56-b3fe-2c6d23d5c1a4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337" status: 200 len: 1678 microversion: 2.1 time: 0.162497 May 13 13:30:19.847117 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 431/842] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:19 2022] GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:20.864301 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4787d091-d98b-4991-89e6-168c5ad4fbdb tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:20.868955 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4787d091-d98b-4991-89e6-168c5ad4fbdb tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:20.871747 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4787d091-d98b-4991-89e6-168c5ad4fbdb tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:20.872268 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4787d091-d98b-4991-89e6-168c5ad4fbdb tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:20.873789 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4787d091-d98b-4991-89e6-168c5ad4fbdb tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:20.874514 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4787d091-d98b-4991-89e6-168c5ad4fbdb tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:20.969081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4787d091-d98b-4991-89e6-168c5ad4fbdb tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:20.976944 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4787d091-d98b-4991-89e6-168c5ad4fbdb tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337" status: 200 len: 1611 microversion: 2.1 time: 0.116349 May 13 13:30:20.990873 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 412/843] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:20 2022] GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337 => generated 1611 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:21.012601 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-8011e83b-e00e-462e-bb42-6fc987ad9e3f req-ef183ab1-2703-462f-818d-eb2cdf172d06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "835a8273-f466-42d9-818d-17b347b44337", "name": "network-vif-deleted", "tag": "78f7e4a5-db41-4b56-9671-ed755318389e"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:30:21.028645 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-8011e83b-e00e-462e-bb42-6fc987ad9e3f req-ef183ab1-2703-462f-818d-eb2cdf172d06 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:21.029221 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-8011e83b-e00e-462e-bb42-6fc987ad9e3f req-ef183ab1-2703-462f-818d-eb2cdf172d06 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:21.042040 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-8011e83b-e00e-462e-bb42-6fc987ad9e3f req-ef183ab1-2703-462f-818d-eb2cdf172d06 service nova] Creating event network-vif-deleted:78f7e4a5-db41-4b56-9671-ed755318389e for instance 835a8273-f466-42d9-818d-17b347b44337 on hv-cinder-84163 May 13 13:30:21.052173 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-8011e83b-e00e-462e-bb42-6fc987ad9e3f req-ef183ab1-2703-462f-818d-eb2cdf172d06 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043339 May 13 13:30:21.053064 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 432/844] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:30:21.485173 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-be9b39d3-323a-451b-b977-97e0a36202d6 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:30:21.485650 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-be9b39d3-323a-451b-b977-97e0a36202d6 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:21.491528 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-be9b39d3-323a-451b-b977-97e0a36202d6 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:21.491972 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-be9b39d3-323a-451b-b977-97e0a36202d6 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:21.492747 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-be9b39d3-323a-451b-b977-97e0a36202d6 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:21.493182 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-be9b39d3-323a-451b-b977-97e0a36202d6 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:21.518943 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-be9b39d3-323a-451b-b977-97e0a36202d6 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lazy-loading 'flavor' on Instance uuid 58f4be22-416d-4465-9e39-d09271f63511 {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:30:21.829962 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-be9b39d3-323a-451b-b977-97e0a36202d6 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "POST /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511/action" status: 202 len: 0 microversion: 2.1 time: 0.349315 May 13 13:30:21.830865 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 413/845] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 13 13:30:21 2022] POST /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:30:21.840068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1c817cf0-08b5-4d7f-86b4-005adc679679 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:21.840777 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1c817cf0-08b5-4d7f-86b4-005adc679679 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:21.848586 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1c817cf0-08b5-4d7f-86b4-005adc679679 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:21.854764 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1c817cf0-08b5-4d7f-86b4-005adc679679 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:21.854764 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1c817cf0-08b5-4d7f-86b4-005adc679679 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:21.854764 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1c817cf0-08b5-4d7f-86b4-005adc679679 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:21.996099 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6ee2ff3a-31c9-4de8-9a5d-ea1881657dc5 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:21.996715 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6ee2ff3a-31c9-4de8-9a5d-ea1881657dc5 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:22.011420 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6ee2ff3a-31c9-4de8-9a5d-ea1881657dc5 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:22.012189 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6ee2ff3a-31c9-4de8-9a5d-ea1881657dc5 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:22.014575 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6ee2ff3a-31c9-4de8-9a5d-ea1881657dc5 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:22.015032 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6ee2ff3a-31c9-4de8-9a5d-ea1881657dc5 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:22.021992 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1c817cf0-08b5-4d7f-86b4-005adc679679 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:22.030626 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1c817cf0-08b5-4d7f-86b4-005adc679679 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1569 microversion: 2.1 time: 0.194868 May 13 13:30:22.031237 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 433/846] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:21 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:22.059054 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6ee2ff3a-31c9-4de8-9a5d-ea1881657dc5 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:22.059515 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6ee2ff3a-31c9-4de8-9a5d-ea1881657dc5 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:22.062428 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-6ee2ff3a-31c9-4de8-9a5d-ea1881657dc5 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lazy-loading 'fault' on Instance uuid 835a8273-f466-42d9-818d-17b347b44337 {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:30:22.111772 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6ee2ff3a-31c9-4de8-9a5d-ea1881657dc5 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25df7c837584b19afe274f6edfb8efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c900748e271404bb3cb11fb2308e784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:22.120830 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6ee2ff3a-31c9-4de8-9a5d-ea1881657dc5 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337" status: 200 len: 1330 microversion: 2.1 time: 0.128411 May 13 13:30:22.121528 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 414/847] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:21 2022] GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337 => generated 1330 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:23.048229 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cac16e5c-3bb5-4343-b0eb-c07c6f9180c5 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:23.048790 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-cac16e5c-3bb5-4343-b0eb-c07c6f9180c5 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:23.055538 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cac16e5c-3bb5-4343-b0eb-c07c6f9180c5 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:23.055974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cac16e5c-3bb5-4343-b0eb-c07c6f9180c5 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:23.056787 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cac16e5c-3bb5-4343-b0eb-c07c6f9180c5 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:23.057291 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cac16e5c-3bb5-4343-b0eb-c07c6f9180c5 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:23.140588 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2f2e49eb-0d5b-432f-aa39-d1650d157bc6 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:23.141200 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2f2e49eb-0d5b-432f-aa39-d1650d157bc6 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:23.147786 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2f2e49eb-0d5b-432f-aa39-d1650d157bc6 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:23.148815 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2f2e49eb-0d5b-432f-aa39-d1650d157bc6 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:23.149010 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2f2e49eb-0d5b-432f-aa39-d1650d157bc6 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:23.149403 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2f2e49eb-0d5b-432f-aa39-d1650d157bc6 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:23.166764 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-2f2e49eb-0d5b-432f-aa39-d1650d157bc6 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] HTTP exception thrown: Instance 835a8273-f466-42d9-818d-17b347b44337 could not be found. May 13 13:30:23.168518 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2f2e49eb-0d5b-432f-aa39-d1650d157bc6 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Request method failure captured: May 13 13:30:23.168518 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337 HTTP/1.1 May 13 13:30:23.168518 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept: application/json May 13 13:30:23.168518 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity May 13 13:30:23.168518 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Connection: close May 13 13:30:23.168518 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Length: 0 May 13 13:30:23.168518 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Type: application/json May 13 13:30:23.168518 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Host: 10.222.0.13 May 13 13:30:23.168518 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None May 13 13:30:23.168518 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 May 13 13:30:23.168518 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiflwBMboKTbh58LY9MV46SCnkvCoDA8Lz7MKk4gwRCoxQPs10Nennf59WSFpA35k2_OuVUqc3Ildqh9KXOiYz1kwf-o_5U0rFqJBoVhvd5RC1KNKMiAiCN3X4-U5A2Z5o8ov4tv4DHgjoV-mWgbm8gyYcnkReiO1lr3jQvWIeRv7-V3g May 13 13:30:23.168518 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Id: None May 13 13:30:23.168518 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Name: None May 13 13:30:23.168518 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed May 13 13:30:23.168518 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True May 13 13:30:23.168518 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default May 13 13:30:23.168518 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default May 13 13:30:23.168518 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:30:23.168518 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:30:23.168518 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Role: member,reader May 13 13:30:23.168518 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Roles: member,reader May 13 13:30:23.170908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2c900748e271404bb3cb11fb2308e784", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}] May 13 13:30:23.170908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:30:23.170908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:30:23.170908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:30:23.170908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:30:23.170908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default May 13 13:30:23.170908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default May 13 13:30:23.170908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Id: e25df7c837584b19afe274f6edfb8efd May 13 13:30:23.170908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:30:23.170908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: method: > May 13 13:30:23.170908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: exception: Instance 835a8273-f466-42d9-818d-17b347b44337 could not be found. May 13 13:30:23.170908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: action_args: {'id': '835a8273-f466-42d9-818d-17b347b44337'} May 13 13:30:23.174559 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:30:23.174559 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:23.174559 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:30:23.174559 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:30:23.174559 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:30:23.174559 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:30:23.174559 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:30:23.174559 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:30:23.174559 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:30:23.174559 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:30:23.174559 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 835a8273-f466-42d9-818d-17b347b44337 could not be found. May 13 13:30:23.174559 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:23.174559 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:23.174559 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:23.174559 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:23.174559 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:23.174559 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:23.174559 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:30:23.174559 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:30:23.174559 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:30:23.177857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:30:23.177857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:30:23.177857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:30:23.177857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:30:23.177857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:30:23.177857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:30:23.177857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:30:23.177857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 835a8273-f466-42d9-818d-17b347b44337 could not be found. May 13 13:30:23.177857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:23.177857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:23.177857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:23.177857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:23.177857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:23.177857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:23.177857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:30:23.177857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:30:23.177857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 835a8273-f466-42d9-818d-17b347b44337 could not be found. May 13 13:30:23.177857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:23.181584 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2f2e49eb-0d5b-432f-aa39-d1650d157bc6 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Returning 404 to user: Instance 835a8273-f466-42d9-818d-17b347b44337 could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:30:23.181584 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2f2e49eb-0d5b-432f-aa39-d1650d157bc6 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337" status: 404 len: 111 microversion: 2.1 time: 0.036989 May 13 13:30:23.181584 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 415/848] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:23 2022] GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 13:30:23.184280 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-89c83371-d238-446f-858c-95d098127ae7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '.version_select at 0x7fb08413caf0>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:23.218077 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-cac16e5c-3bb5-4343-b0eb-c07c6f9180c5 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:23.229860 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-cac16e5c-3bb5-4343-b0eb-c07c6f9180c5 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1569 microversion: 2.1 time: 0.182860 May 13 13:30:23.229860 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 434/849] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:23 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:23.281078 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-89c83371-d238-446f-858c-95d098127ae7 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-200539823" status: 202 len: 0 microversion: 2.1 time: 0.102535 May 13 13:30:23.281655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 416/850] 10.222.0.13 () {58 vars in 1217 bytes} [Fri May 13 13:30:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-200539823 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:30:24.244511 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-75fd7b76-3766-466d-abaf-95614fdccada tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:24.245052 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-75fd7b76-3766-466d-abaf-95614fdccada tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:24.252381 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-75fd7b76-3766-466d-abaf-95614fdccada tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:24.252820 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-75fd7b76-3766-466d-abaf-95614fdccada tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:24.253964 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-75fd7b76-3766-466d-abaf-95614fdccada tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:24.254313 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-75fd7b76-3766-466d-abaf-95614fdccada tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:24.554864 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-75fd7b76-3766-466d-abaf-95614fdccada tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:24.563277 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-75fd7b76-3766-466d-abaf-95614fdccada tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1569 microversion: 2.1 time: 0.322650 May 13 13:30:24.563901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 435/851] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:24 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1569 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:24.854715 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-465dafa3-fec7-4247-92cc-9bdc9e6149b3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:24.855812 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-465dafa3-fec7-4247-92cc-9bdc9e6149b3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:24.864308 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-465dafa3-fec7-4247-92cc-9bdc9e6149b3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:24.866808 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-465dafa3-fec7-4247-92cc-9bdc9e6149b3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:24.866808 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-465dafa3-fec7-4247-92cc-9bdc9e6149b3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:24.866808 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-465dafa3-fec7-4247-92cc-9bdc9e6149b3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:24.896067 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-465dafa3-fec7-4247-92cc-9bdc9e6149b3 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045991 May 13 13:30:24.896640 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 417/852] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 13 13:30:24 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:24.961070 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a166bc6c-14b6-4f5f-9a6d-0b4179bdd9f0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:24.961602 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a166bc6c-14b6-4f5f-9a6d-0b4179bdd9f0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:24.968299 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a166bc6c-14b6-4f5f-9a6d-0b4179bdd9f0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:24.968731 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a166bc6c-14b6-4f5f-9a6d-0b4179bdd9f0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:24.969521 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a166bc6c-14b6-4f5f-9a6d-0b4179bdd9f0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:24.969955 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a166bc6c-14b6-4f5f-9a6d-0b4179bdd9f0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:24.996071 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a166bc6c-14b6-4f5f-9a6d-0b4179bdd9f0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Going to try to terminate instance {{(pid=117721) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:30:25.411588 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a166bc6c-14b6-4f5f-9a6d-0b4179bdd9f0 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "DELETE /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 204 len: 0 microversion: 2.20 time: 0.453384 May 13 13:30:25.412474 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 436/853] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 13 13:30:24 2022] DELETE /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 13 13:30:25.422631 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5e5b075d-9513-4094-9567-b0eba9186305 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:25.430359 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5e5b075d-9513-4094-9567-b0eba9186305 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:25.431905 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5e5b075d-9513-4094-9567-b0eba9186305 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:25.432633 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5e5b075d-9513-4094-9567-b0eba9186305 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:25.433879 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5e5b075d-9513-4094-9567-b0eba9186305 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:25.436437 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5e5b075d-9513-4094-9567-b0eba9186305 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:25.482866 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f69e5fb5-31b6-4c6a-a1d4-f310e726b402 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:25.483553 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f69e5fb5-31b6-4c6a-a1d4-f310e726b402 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:25.491685 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f69e5fb5-31b6-4c6a-a1d4-f310e726b402 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:25.492659 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f69e5fb5-31b6-4c6a-a1d4-f310e726b402 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:25.493912 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f69e5fb5-31b6-4c6a-a1d4-f310e726b402 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:25.494622 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f69e5fb5-31b6-4c6a-a1d4-f310e726b402 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:25.519728 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-f69e5fb5-31b6-4c6a-a1d4-f310e726b402 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] HTTP exception thrown: Instance 835a8273-f466-42d9-818d-17b347b44337 could not be found. May 13 13:30:25.521569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f69e5fb5-31b6-4c6a-a1d4-f310e726b402 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Request method failure captured: May 13 13:30:25.521569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: DELETE /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337 HTTP/1.1 May 13 13:30:25.521569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:30:25.521569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:30:25.521569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:30:25.521569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:30:25.521569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:30:25.521569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:30:25.521569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:30:25.521569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:30:25.521569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiflwBMboKTbh58LY9MV46SCnkvCoDA8Lz7MKk4gwRCoxQPs10Nennf59WSFpA35k2_OuVUqc3Ildqh9KXOiYz1kwf-o_5U0rFqJBoVhvd5RC1KNKMiAiCN3X4-U5A2Z5o8ov4tv4DHgjoV-mWgbm8gyYcnkReiO1lr3jQvWIeRv7-V3g May 13 13:30:25.521569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:30:25.521569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:30:25.521569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:30:25.521569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:30:25.521569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:30:25.521569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:30:25.521569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:30:25.521569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:30:25.521569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:30:25.521569 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:30:25.522896 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2c900748e271404bb3cb11fb2308e784", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}] May 13 13:30:25.522896 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:30:25.522896 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:30:25.522896 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:30:25.522896 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:30:25.522896 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:30:25.522896 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:30:25.522896 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: e25df7c837584b19afe274f6edfb8efd May 13 13:30:25.522896 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:30:25.522896 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: > May 13 13:30:25.522896 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Instance 835a8273-f466-42d9-818d-17b347b44337 could not be found. May 13 13:30:25.522896 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': '835a8273-f466-42d9-818d-17b347b44337'} May 13 13:30:25.523629 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:30:25.523629 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:25.523629 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:30:25.523629 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:30:25.523629 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:30:25.523629 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:30:25.523629 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:30:25.523629 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:30:25.523629 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:30:25.523629 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:30:25.523629 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 835a8273-f466-42d9-818d-17b347b44337 could not be found. May 13 13:30:25.523629 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:25.523629 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:25.523629 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:25.523629 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:25.523629 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:25.523629 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:25.523629 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:30:25.523629 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:30:25.523629 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:30:25.524824 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:30:25.524824 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:30:25.524824 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:30:25.524824 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:30:25.524824 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:30:25.524824 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:30:25.524824 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:30:25.524824 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:30:25.524824 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:30:25.524824 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 835a8273-f466-42d9-818d-17b347b44337 could not be found. May 13 13:30:25.524824 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:25.524824 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:25.524824 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:25.524824 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:25.524824 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:25.524824 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:25.524824 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:30:25.524824 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:30:25.524824 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 835a8273-f466-42d9-818d-17b347b44337 could not be found. May 13 13:30:25.524824 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:25.526061 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f69e5fb5-31b6-4c6a-a1d4-f310e726b402 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Returning 404 to user: Instance 835a8273-f466-42d9-818d-17b347b44337 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:30:25.526061 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f69e5fb5-31b6-4c6a-a1d4-f310e726b402 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "DELETE /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337" status: 404 len: 111 microversion: 2.1 time: 0.044656 May 13 13:30:25.526061 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 437/854] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:30:25 2022] DELETE /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 13:30:25.532430 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ab31b4c6-a7a4-44e7-bbaa-f46e2d59864a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:25.533222 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ab31b4c6-a7a4-44e7-bbaa-f46e2d59864a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 835a8273-f466-42d9-818d-17b347b44337] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:25.539849 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ab31b4c6-a7a4-44e7-bbaa-f46e2d59864a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:25.549532 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ab31b4c6-a7a4-44e7-bbaa-f46e2d59864a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:25.549532 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ab31b4c6-a7a4-44e7-bbaa-f46e2d59864a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:25.549532 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ab31b4c6-a7a4-44e7-bbaa-f46e2d59864a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:25.571659 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-ab31b4c6-a7a4-44e7-bbaa-f46e2d59864a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] HTTP exception thrown: Instance 835a8273-f466-42d9-818d-17b347b44337 could not be found. May 13 13:30:25.573267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ab31b4c6-a7a4-44e7-bbaa-f46e2d59864a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Request method failure captured: May 13 13:30:25.573267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337 HTTP/1.1 May 13 13:30:25.573267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:30:25.573267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:30:25.573267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:30:25.573267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:30:25.573267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:30:25.573267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:30:25.573267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:30:25.573267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:30:25.573267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiflwBMboKTbh58LY9MV46SCnkvCoDA8Lz7MKk4gwRCoxQPs10Nennf59WSFpA35k2_OuVUqc3Ildqh9KXOiYz1kwf-o_5U0rFqJBoVhvd5RC1KNKMiAiCN3X4-U5A2Z5o8ov4tv4DHgjoV-mWgbm8gyYcnkReiO1lr3jQvWIeRv7-V3g May 13 13:30:25.573267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:30:25.573267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:30:25.573267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:30:25.573267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:30:25.573267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:30:25.573267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:30:25.573267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:30:25.573267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:30:25.573267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:30:25.573267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:30:25.577890 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2c900748e271404bb3cb11fb2308e784", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}] May 13 13:30:25.577890 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:30:25.577890 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:30:25.577890 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:30:25.577890 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:30:25.577890 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:30:25.577890 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:30:25.577890 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: e25df7c837584b19afe274f6edfb8efd May 13 13:30:25.577890 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:30:25.577890 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: > May 13 13:30:25.577890 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Instance 835a8273-f466-42d9-818d-17b347b44337 could not be found. May 13 13:30:25.577890 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': '835a8273-f466-42d9-818d-17b347b44337'} May 13 13:30:25.578874 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:30:25.578874 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:25.578874 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:30:25.578874 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:30:25.578874 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:30:25.578874 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:30:25.578874 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:30:25.578874 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:30:25.578874 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:30:25.578874 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:30:25.578874 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 835a8273-f466-42d9-818d-17b347b44337 could not be found. May 13 13:30:25.578874 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:25.578874 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:25.578874 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:25.578874 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:25.578874 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:25.578874 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:25.578874 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:30:25.578874 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:30:25.578874 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:30:25.580174 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:30:25.580174 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:30:25.580174 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:30:25.580174 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:30:25.580174 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:30:25.580174 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:30:25.580174 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:30:25.580174 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 835a8273-f466-42d9-818d-17b347b44337 could not be found. May 13 13:30:25.580174 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:25.580174 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:25.580174 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:25.580174 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:25.580174 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:25.580174 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:25.580174 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:30:25.580174 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:30:25.580174 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 835a8273-f466-42d9-818d-17b347b44337 could not be found. May 13 13:30:25.580174 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:25.581246 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ab31b4c6-a7a4-44e7-bbaa-f46e2d59864a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Returning 404 to user: Instance 835a8273-f466-42d9-818d-17b347b44337 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:30:25.581246 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ab31b4c6-a7a4-44e7-bbaa-f46e2d59864a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337" status: 404 len: 111 microversion: 2.1 time: 0.047469 May 13 13:30:25.581246 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 438/855] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:25 2022] GET /compute/v2.1/servers/835a8273-f466-42d9-818d-17b347b44337 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 13:30:25.585013 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-236fc49d-fb35-41a7-84ca-9bc56e079211 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:25.585698 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-236fc49d-fb35-41a7-84ca-9bc56e079211 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:25.593345 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-236fc49d-fb35-41a7-84ca-9bc56e079211 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:25.593811 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-236fc49d-fb35-41a7-84ca-9bc56e079211 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:25.594635 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-236fc49d-fb35-41a7-84ca-9bc56e079211 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:25.595064 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-236fc49d-fb35-41a7-84ca-9bc56e079211 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:25.659170 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5e5b075d-9513-4094-9567-b0eba9186305 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:25.672730 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5e5b075d-9513-4094-9567-b0eba9186305 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:25.674772 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5e5b075d-9513-4094-9567-b0eba9186305 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:25.680844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5e5b075d-9513-4094-9567-b0eba9186305 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1723 microversion: 2.20 time: 0.257804 May 13 13:30:25.680844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 418/856] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:30:25 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:30:25.780806 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-236fc49d-fb35-41a7-84ca-9bc56e079211 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:25.792862 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-236fc49d-fb35-41a7-84ca-9bc56e079211 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1569 microversion: 2.1 time: 0.211727 May 13 13:30:25.801321 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 439/857] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:25 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1569 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:26.695552 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-305d3bd7-41f1-49ea-bdbc-ed9e2ef69d37 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:26.696242 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-305d3bd7-41f1-49ea-bdbc-ed9e2ef69d37 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:26.703842 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-305d3bd7-41f1-49ea-bdbc-ed9e2ef69d37 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:26.704379 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-305d3bd7-41f1-49ea-bdbc-ed9e2ef69d37 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:26.705151 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-305d3bd7-41f1-49ea-bdbc-ed9e2ef69d37 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:26.707612 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-305d3bd7-41f1-49ea-bdbc-ed9e2ef69d37 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:26.812609 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0dd1a8d0-e403-47ad-8486-0ce5dd01bcc7 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:26.813293 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0dd1a8d0-e403-47ad-8486-0ce5dd01bcc7 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:26.820262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0dd1a8d0-e403-47ad-8486-0ce5dd01bcc7 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:26.820709 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0dd1a8d0-e403-47ad-8486-0ce5dd01bcc7 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:26.821727 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0dd1a8d0-e403-47ad-8486-0ce5dd01bcc7 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:26.822161 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0dd1a8d0-e403-47ad-8486-0ce5dd01bcc7 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:26.854321 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-305d3bd7-41f1-49ea-bdbc-ed9e2ef69d37 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:26.870508 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-305d3bd7-41f1-49ea-bdbc-ed9e2ef69d37 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:26.872463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-305d3bd7-41f1-49ea-bdbc-ed9e2ef69d37 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:26.874808 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-305d3bd7-41f1-49ea-bdbc-ed9e2ef69d37 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1723 microversion: 2.20 time: 0.183470 May 13 13:30:26.876006 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 419/858] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:30:26 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:30:26.980626 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0dd1a8d0-e403-47ad-8486-0ce5dd01bcc7 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:26.989414 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0dd1a8d0-e403-47ad-8486-0ce5dd01bcc7 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1569 microversion: 2.1 time: 0.181498 May 13 13:30:26.990243 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 440/859] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:26 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:30:27.112801 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3935927f-4711-4b89-ac7e-3fa865d37f0a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:27.113748 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3935927f-4711-4b89-ac7e-3fa865d37f0a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:27.119861 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3935927f-4711-4b89-ac7e-3fa865d37f0a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:27.120320 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3935927f-4711-4b89-ac7e-3fa865d37f0a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:27.121137 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3935927f-4711-4b89-ac7e-3fa865d37f0a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:27.121628 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3935927f-4711-4b89-ac7e-3fa865d37f0a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:27.137174 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-3935927f-4711-4b89-ac7e-3fa865d37f0a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] HTTP exception thrown: Instance f7d1447f-444f-4e0c-a20d-9350788fd819 could not be found. May 13 13:30:27.140566 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3935927f-4711-4b89-ac7e-3fa865d37f0a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Request method failure captured: May 13 13:30:27.140566 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: request: DELETE /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819 HTTP/1.1 May 13 13:30:27.140566 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept: application/json May 13 13:30:27.140566 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity May 13 13:30:27.140566 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Connection: close May 13 13:30:27.140566 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Length: 0 May 13 13:30:27.140566 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Type: application/json May 13 13:30:27.140566 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Host: 10.222.0.13 May 13 13:30:27.140566 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None May 13 13:30:27.140566 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 May 13 13:30:27.140566 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiflwBMboKTbh58LY9MV46SCnkvCoDA8Lz7MKk4gwRCoxQPs10Nennf59WSFpA35k2_OuVUqc3Ildqh9KXOiYz1kwf-o_5U0rFqJBoVhvd5RC1KNKMiAiCN3X4-U5A2Z5o8ov4tv4DHgjoV-mWgbm8gyYcnkReiO1lr3jQvWIeRv7-V3g May 13 13:30:27.140566 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Id: None May 13 13:30:27.140566 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Name: None May 13 13:30:27.140566 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed May 13 13:30:27.140566 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True May 13 13:30:27.140566 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default May 13 13:30:27.140566 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default May 13 13:30:27.140566 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:30:27.140566 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:30:27.140566 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Role: member,reader May 13 13:30:27.140566 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Roles: member,reader May 13 13:30:27.142130 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2c900748e271404bb3cb11fb2308e784", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}] May 13 13:30:27.142130 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:30:27.142130 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:30:27.142130 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:30:27.142130 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:30:27.142130 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default May 13 13:30:27.142130 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default May 13 13:30:27.142130 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Id: e25df7c837584b19afe274f6edfb8efd May 13 13:30:27.142130 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:30:27.142130 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: method: > May 13 13:30:27.142130 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: exception: Instance f7d1447f-444f-4e0c-a20d-9350788fd819 could not be found. May 13 13:30:27.142130 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: action_args: {'id': 'f7d1447f-444f-4e0c-a20d-9350788fd819'} May 13 13:30:27.143220 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:30:27.143220 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:27.143220 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:30:27.143220 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:30:27.143220 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:30:27.143220 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:30:27.143220 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:30:27.143220 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:30:27.143220 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:30:27.143220 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:30:27.143220 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7d1447f-444f-4e0c-a20d-9350788fd819 could not be found. May 13 13:30:27.143220 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:27.143220 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:27.143220 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:27.143220 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:27.143220 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:27.143220 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:27.143220 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:30:27.143220 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:30:27.143220 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:30:27.144484 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:30:27.144484 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:30:27.144484 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:30:27.144484 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:30:27.144484 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:30:27.144484 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:30:27.144484 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:30:27.144484 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:30:27.144484 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:30:27.144484 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7d1447f-444f-4e0c-a20d-9350788fd819 could not be found. May 13 13:30:27.144484 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:27.144484 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:27.144484 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:27.144484 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:27.144484 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:27.144484 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:27.144484 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:30:27.144484 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:30:27.144484 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7d1447f-444f-4e0c-a20d-9350788fd819 could not be found. May 13 13:30:27.144484 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:27.146877 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3935927f-4711-4b89-ac7e-3fa865d37f0a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Returning 404 to user: Instance f7d1447f-444f-4e0c-a20d-9350788fd819 could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:30:27.146877 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3935927f-4711-4b89-ac7e-3fa865d37f0a tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819" status: 404 len: 111 microversion: 2.1 time: 0.032094 May 13 13:30:27.149756 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-86fd5d29-65ae-4bce-b2fe-e4945ad42847 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:27.150412 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-86fd5d29-65ae-4bce-b2fe-e4945ad42847 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: f7d1447f-444f-4e0c-a20d-9350788fd819] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:27.153023 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 420/860] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:30:27 2022] DELETE /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:30:27.156905 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-86fd5d29-65ae-4bce-b2fe-e4945ad42847 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:27.157361 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-86fd5d29-65ae-4bce-b2fe-e4945ad42847 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:27.158151 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-86fd5d29-65ae-4bce-b2fe-e4945ad42847 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:27.158649 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-86fd5d29-65ae-4bce-b2fe-e4945ad42847 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:27.173919 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-86fd5d29-65ae-4bce-b2fe-e4945ad42847 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] HTTP exception thrown: Instance f7d1447f-444f-4e0c-a20d-9350788fd819 could not be found. May 13 13:30:27.176066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-86fd5d29-65ae-4bce-b2fe-e4945ad42847 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Request method failure captured: May 13 13:30:27.176066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819 HTTP/1.1 May 13 13:30:27.176066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:30:27.176066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:30:27.176066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:30:27.176066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:30:27.176066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:30:27.176066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:30:27.176066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:30:27.176066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:30:27.176066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiflwBMboKTbh58LY9MV46SCnkvCoDA8Lz7MKk4gwRCoxQPs10Nennf59WSFpA35k2_OuVUqc3Ildqh9KXOiYz1kwf-o_5U0rFqJBoVhvd5RC1KNKMiAiCN3X4-U5A2Z5o8ov4tv4DHgjoV-mWgbm8gyYcnkReiO1lr3jQvWIeRv7-V3g May 13 13:30:27.176066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:30:27.176066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:30:27.176066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:30:27.176066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:30:27.176066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:30:27.176066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:30:27.176066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:30:27.176066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:30:27.176066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:30:27.176066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:30:27.177643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2c900748e271404bb3cb11fb2308e784", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}] May 13 13:30:27.177643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:30:27.177643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:30:27.177643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:30:27.177643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:30:27.177643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:30:27.177643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:30:27.177643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: e25df7c837584b19afe274f6edfb8efd May 13 13:30:27.177643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:30:27.177643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: > May 13 13:30:27.177643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Instance f7d1447f-444f-4e0c-a20d-9350788fd819 could not be found. May 13 13:30:27.177643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': 'f7d1447f-444f-4e0c-a20d-9350788fd819'} May 13 13:30:27.178512 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:30:27.178512 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:27.178512 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:30:27.178512 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:30:27.178512 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:30:27.178512 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:30:27.178512 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:30:27.178512 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:30:27.178512 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:30:27.178512 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:30:27.178512 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7d1447f-444f-4e0c-a20d-9350788fd819 could not be found. May 13 13:30:27.178512 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:27.178512 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:27.178512 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:27.178512 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:27.178512 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:27.178512 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:27.178512 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:30:27.178512 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:30:27.178512 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:30:27.179897 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:30:27.179897 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:30:27.179897 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:30:27.179897 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:30:27.179897 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:30:27.179897 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:30:27.179897 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:30:27.179897 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7d1447f-444f-4e0c-a20d-9350788fd819 could not be found. May 13 13:30:27.179897 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:27.179897 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:27.179897 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:27.179897 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:27.179897 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:27.179897 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:27.179897 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:30:27.179897 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:30:27.179897 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7d1447f-444f-4e0c-a20d-9350788fd819 could not be found. May 13 13:30:27.179897 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:27.181751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-86fd5d29-65ae-4bce-b2fe-e4945ad42847 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Returning 404 to user: Instance f7d1447f-444f-4e0c-a20d-9350788fd819 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:30:27.182995 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-86fd5d29-65ae-4bce-b2fe-e4945ad42847 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819" status: 404 len: 111 microversion: 2.1 time: 0.037433 May 13 13:30:27.183650 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 441/861] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:27 2022] GET /compute/v2.1/servers/f7d1447f-444f-4e0c-a20d-9350788fd819 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:30:27.195482 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4f53eddf-92b6-4ce4-9613-ec34e1a3388f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:27.195482 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4f53eddf-92b6-4ce4-9613-ec34e1a3388f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:27.203141 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4f53eddf-92b6-4ce4-9613-ec34e1a3388f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:27.204215 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4f53eddf-92b6-4ce4-9613-ec34e1a3388f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:27.204412 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4f53eddf-92b6-4ce4-9613-ec34e1a3388f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:27.205190 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4f53eddf-92b6-4ce4-9613-ec34e1a3388f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:27.220806 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-4f53eddf-92b6-4ce4-9613-ec34e1a3388f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] HTTP exception thrown: Instance 14bddf7f-e172-4c36-8cb5-8752d556e11b could not be found. May 13 13:30:27.222498 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4f53eddf-92b6-4ce4-9613-ec34e1a3388f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Request method failure captured: May 13 13:30:27.222498 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: request: DELETE /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b HTTP/1.1 May 13 13:30:27.222498 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept: application/json May 13 13:30:27.222498 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity May 13 13:30:27.222498 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Connection: close May 13 13:30:27.222498 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Length: 0 May 13 13:30:27.222498 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Type: application/json May 13 13:30:27.222498 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Host: 10.222.0.13 May 13 13:30:27.222498 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None May 13 13:30:27.222498 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 May 13 13:30:27.222498 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiflwBMboKTbh58LY9MV46SCnkvCoDA8Lz7MKk4gwRCoxQPs10Nennf59WSFpA35k2_OuVUqc3Ildqh9KXOiYz1kwf-o_5U0rFqJBoVhvd5RC1KNKMiAiCN3X4-U5A2Z5o8ov4tv4DHgjoV-mWgbm8gyYcnkReiO1lr3jQvWIeRv7-V3g May 13 13:30:27.222498 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Id: None May 13 13:30:27.222498 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Name: None May 13 13:30:27.222498 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed May 13 13:30:27.222498 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True May 13 13:30:27.222498 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default May 13 13:30:27.222498 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default May 13 13:30:27.222498 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:30:27.222498 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:30:27.222498 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Role: member,reader May 13 13:30:27.222498 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Roles: member,reader May 13 13:30:27.224135 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2c900748e271404bb3cb11fb2308e784", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}] May 13 13:30:27.224135 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:30:27.224135 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:30:27.224135 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:30:27.224135 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:30:27.224135 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default May 13 13:30:27.224135 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default May 13 13:30:27.224135 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Id: e25df7c837584b19afe274f6edfb8efd May 13 13:30:27.224135 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:30:27.224135 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: method: > May 13 13:30:27.224135 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: exception: Instance 14bddf7f-e172-4c36-8cb5-8752d556e11b could not be found. May 13 13:30:27.224135 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: action_args: {'id': '14bddf7f-e172-4c36-8cb5-8752d556e11b'} May 13 13:30:27.224884 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:30:27.224884 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:27.224884 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:30:27.224884 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:30:27.224884 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:30:27.224884 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:30:27.224884 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:30:27.224884 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:30:27.224884 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:30:27.224884 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:30:27.224884 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14bddf7f-e172-4c36-8cb5-8752d556e11b could not be found. May 13 13:30:27.224884 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:27.224884 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:27.224884 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:27.224884 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:27.224884 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:27.224884 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:27.224884 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:30:27.224884 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:30:27.224884 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:30:27.226405 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:30:27.226405 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:30:27.226405 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:30:27.226405 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:30:27.226405 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:30:27.226405 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:30:27.226405 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:30:27.226405 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:30:27.226405 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:30:27.226405 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14bddf7f-e172-4c36-8cb5-8752d556e11b could not be found. May 13 13:30:27.226405 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:27.226405 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:27.226405 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:27.226405 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:27.226405 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:27.226405 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:27.226405 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:30:27.226405 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:30:27.226405 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14bddf7f-e172-4c36-8cb5-8752d556e11b could not be found. May 13 13:30:27.226405 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:27.227790 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4f53eddf-92b6-4ce4-9613-ec34e1a3388f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Returning 404 to user: Instance 14bddf7f-e172-4c36-8cb5-8752d556e11b could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:30:27.227790 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4f53eddf-92b6-4ce4-9613-ec34e1a3388f tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "DELETE /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 404 len: 111 microversion: 2.1 time: 0.034570 May 13 13:30:27.227790 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 421/862] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:30:27 2022] DELETE /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:30:27.233622 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8248b99b-5d70-4d30-ae88-da802ceb3e14 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:27.234082 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8248b99b-5d70-4d30-ae88-da802ceb3e14 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: 14bddf7f-e172-4c36-8cb5-8752d556e11b] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:27.240536 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8248b99b-5d70-4d30-ae88-da802ceb3e14 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:27.240990 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8248b99b-5d70-4d30-ae88-da802ceb3e14 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:27.241824 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8248b99b-5d70-4d30-ae88-da802ceb3e14 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:27.242287 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8248b99b-5d70-4d30-ae88-da802ceb3e14 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:27.265531 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-8248b99b-5d70-4d30-ae88-da802ceb3e14 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] HTTP exception thrown: Instance 14bddf7f-e172-4c36-8cb5-8752d556e11b could not be found. May 13 13:30:27.265531 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8248b99b-5d70-4d30-ae88-da802ceb3e14 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Request method failure captured: May 13 13:30:27.265531 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b HTTP/1.1 May 13 13:30:27.265531 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:30:27.265531 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:30:27.265531 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:30:27.265531 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:30:27.265531 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:30:27.265531 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:30:27.265531 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:30:27.265531 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:30:27.265531 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiflwBMboKTbh58LY9MV46SCnkvCoDA8Lz7MKk4gwRCoxQPs10Nennf59WSFpA35k2_OuVUqc3Ildqh9KXOiYz1kwf-o_5U0rFqJBoVhvd5RC1KNKMiAiCN3X4-U5A2Z5o8ov4tv4DHgjoV-mWgbm8gyYcnkReiO1lr3jQvWIeRv7-V3g May 13 13:30:27.265531 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:30:27.265531 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:30:27.265531 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:30:27.265531 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:30:27.265531 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:30:27.265531 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:30:27.265531 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:30:27.265531 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:30:27.265531 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:30:27.265531 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:30:27.267285 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2c900748e271404bb3cb11fb2308e784", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}] May 13 13:30:27.267285 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:30:27.267285 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:30:27.267285 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:30:27.267285 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:30:27.267285 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:30:27.267285 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:30:27.267285 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: e25df7c837584b19afe274f6edfb8efd May 13 13:30:27.267285 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:30:27.267285 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: > May 13 13:30:27.267285 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Instance 14bddf7f-e172-4c36-8cb5-8752d556e11b could not be found. May 13 13:30:27.267285 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': '14bddf7f-e172-4c36-8cb5-8752d556e11b'} May 13 13:30:27.268263 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:30:27.268263 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:27.268263 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:30:27.268263 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:30:27.268263 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:30:27.268263 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:30:27.268263 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:30:27.268263 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:30:27.268263 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:30:27.268263 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:30:27.268263 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14bddf7f-e172-4c36-8cb5-8752d556e11b could not be found. May 13 13:30:27.268263 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:27.268263 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:27.268263 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:27.268263 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:27.268263 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:27.268263 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:27.268263 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:30:27.268263 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:30:27.268263 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:30:27.269644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:30:27.269644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:30:27.269644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:30:27.269644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:30:27.269644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:30:27.269644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:30:27.269644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:30:27.269644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14bddf7f-e172-4c36-8cb5-8752d556e11b could not be found. May 13 13:30:27.269644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:27.269644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:27.269644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:27.269644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:27.269644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:27.269644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:27.269644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:30:27.269644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:30:27.269644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14bddf7f-e172-4c36-8cb5-8752d556e11b could not be found. May 13 13:30:27.269644 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:27.271978 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8248b99b-5d70-4d30-ae88-da802ceb3e14 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Returning 404 to user: Instance 14bddf7f-e172-4c36-8cb5-8752d556e11b could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:30:27.271978 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8248b99b-5d70-4d30-ae88-da802ceb3e14 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b" status: 404 len: 111 microversion: 2.1 time: 0.035908 May 13 13:30:27.271978 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 442/863] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:27 2022] GET /compute/v2.1/servers/14bddf7f-e172-4c36-8cb5-8752d556e11b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:30:27.893477 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-dfb5a9b9-aa58-49d3-b8fa-4eb64559580a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:27.894236 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-dfb5a9b9-aa58-49d3-b8fa-4eb64559580a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:27.901404 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dfb5a9b9-aa58-49d3-b8fa-4eb64559580a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:27.901862 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dfb5a9b9-aa58-49d3-b8fa-4eb64559580a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:27.902768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dfb5a9b9-aa58-49d3-b8fa-4eb64559580a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:27.903211 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dfb5a9b9-aa58-49d3-b8fa-4eb64559580a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:27.921911 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-3b96e228-9021-43b3-949d-fcde33e120f1 req-af16047f-72eb-49f1-a57c-337dc83d700c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "274c20ca-135a-48d9-85e5-7c99cf77f68d", "name": "network-vif-deleted", "tag": "729dc6f6-46b1-4dac-a320-fa9e54753c1c"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:30:27.957330 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-3b96e228-9021-43b3-949d-fcde33e120f1 req-af16047f-72eb-49f1-a57c-337dc83d700c service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:27.958265 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-3b96e228-9021-43b3-949d-fcde33e120f1 req-af16047f-72eb-49f1-a57c-337dc83d700c service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:27.985043 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-3b96e228-9021-43b3-949d-fcde33e120f1 req-af16047f-72eb-49f1-a57c-337dc83d700c service nova] Creating event network-vif-deleted:729dc6f6-46b1-4dac-a320-fa9e54753c1c for instance 274c20ca-135a-48d9-85e5-7c99cf77f68d on hv-cinder-84163 May 13 13:30:27.986846 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dfb5a9b9-aa58-49d3-b8fa-4eb64559580a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:27.993558 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-3b96e228-9021-43b3-949d-fcde33e120f1 req-af16047f-72eb-49f1-a57c-337dc83d700c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077183 May 13 13:30:27.995247 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 443/864] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:30:27.997058 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dfb5a9b9-aa58-49d3-b8fa-4eb64559580a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:27.999569 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dfb5a9b9-aa58-49d3-b8fa-4eb64559580a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:28.000532 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-dfb5a9b9-aa58-49d3-b8fa-4eb64559580a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1655 microversion: 2.20 time: 0.110923 May 13 13:30:28.006506 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 422/865] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:30:27 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1655 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:30:28.020559 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-20919346-27de-448c-bab6-a44c68e6593b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:28.021416 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-20919346-27de-448c-bab6-a44c68e6593b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:28.028948 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-20919346-27de-448c-bab6-a44c68e6593b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:28.029516 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-20919346-27de-448c-bab6-a44c68e6593b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:28.030684 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-20919346-27de-448c-bab6-a44c68e6593b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:28.031375 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-20919346-27de-448c-bab6-a44c68e6593b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:28.340566 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-20919346-27de-448c-bab6-a44c68e6593b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:28.387834 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-20919346-27de-448c-bab6-a44c68e6593b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1569 microversion: 2.1 time: 0.381205 May 13 13:30:28.388601 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 444/866] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:28 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1569 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:28.638289 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6668152c-f527-4505-a296-4c0ea74f773b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:28.638851 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6668152c-f527-4505-a296-4c0ea74f773b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:28.645752 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6668152c-f527-4505-a296-4c0ea74f773b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:28.646233 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6668152c-f527-4505-a296-4c0ea74f773b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:28.647262 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6668152c-f527-4505-a296-4c0ea74f773b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:28.647699 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6668152c-f527-4505-a296-4c0ea74f773b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:28.663173 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-6668152c-f527-4505-a296-4c0ea74f773b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] HTTP exception thrown: Instance b86888c8-bdd2-468d-a602-67b4f27fb7af could not be found. May 13 13:30:28.670750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6668152c-f527-4505-a296-4c0ea74f773b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Request method failure captured: May 13 13:30:28.670750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: request: DELETE /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af HTTP/1.1 May 13 13:30:28.670750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept: application/json May 13 13:30:28.670750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity May 13 13:30:28.670750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Connection: close May 13 13:30:28.670750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Length: 0 May 13 13:30:28.670750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Type: application/json May 13 13:30:28.670750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Host: 10.222.0.13 May 13 13:30:28.670750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None May 13 13:30:28.670750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 May 13 13:30:28.670750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiflwBMboKTbh58LY9MV46SCnkvCoDA8Lz7MKk4gwRCoxQPs10Nennf59WSFpA35k2_OuVUqc3Ildqh9KXOiYz1kwf-o_5U0rFqJBoVhvd5RC1KNKMiAiCN3X4-U5A2Z5o8ov4tv4DHgjoV-mWgbm8gyYcnkReiO1lr3jQvWIeRv7-V3g May 13 13:30:28.670750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Id: None May 13 13:30:28.670750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Name: None May 13 13:30:28.670750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed May 13 13:30:28.670750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True May 13 13:30:28.670750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default May 13 13:30:28.670750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default May 13 13:30:28.670750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:30:28.670750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:30:28.670750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Role: member,reader May 13 13:30:28.670750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Roles: member,reader May 13 13:30:28.672189 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2c900748e271404bb3cb11fb2308e784", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}] May 13 13:30:28.672189 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:30:28.672189 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:30:28.672189 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:30:28.672189 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:30:28.672189 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default May 13 13:30:28.672189 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default May 13 13:30:28.672189 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Id: e25df7c837584b19afe274f6edfb8efd May 13 13:30:28.672189 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:30:28.672189 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: method: > May 13 13:30:28.672189 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: exception: Instance b86888c8-bdd2-468d-a602-67b4f27fb7af could not be found. May 13 13:30:28.672189 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: action_args: {'id': 'b86888c8-bdd2-468d-a602-67b4f27fb7af'} May 13 13:30:28.672959 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:30:28.672959 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:28.672959 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:30:28.672959 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:30:28.672959 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:30:28.672959 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:30:28.672959 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:30:28.672959 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:30:28.672959 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:30:28.672959 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:30:28.672959 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b86888c8-bdd2-468d-a602-67b4f27fb7af could not be found. May 13 13:30:28.672959 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:28.672959 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:28.672959 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:28.672959 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:28.672959 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:28.672959 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:28.672959 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:30:28.672959 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:30:28.672959 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:30:28.674439 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:30:28.674439 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:30:28.674439 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:30:28.674439 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:30:28.674439 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:30:28.674439 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:30:28.674439 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:30:28.674439 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:30:28.674439 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:30:28.674439 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b86888c8-bdd2-468d-a602-67b4f27fb7af could not be found. May 13 13:30:28.674439 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:28.674439 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:28.674439 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:28.674439 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:28.674439 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:28.674439 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:28.674439 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:30:28.674439 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:30:28.674439 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b86888c8-bdd2-468d-a602-67b4f27fb7af could not be found. May 13 13:30:28.674439 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:28.675864 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6668152c-f527-4505-a296-4c0ea74f773b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Returning 404 to user: Instance b86888c8-bdd2-468d-a602-67b4f27fb7af could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:30:28.675864 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6668152c-f527-4505-a296-4c0ea74f773b tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af" status: 404 len: 111 microversion: 2.1 time: 0.032679 May 13 13:30:28.675864 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 423/867] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:30:28 2022] DELETE /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:30:28.683783 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5c70ab1d-2ada-4bd4-8ed2-1a8cb83a9ae4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:28.684605 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5c70ab1d-2ada-4bd4-8ed2-1a8cb83a9ae4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] [instance: b86888c8-bdd2-468d-a602-67b4f27fb7af] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:28.697394 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5c70ab1d-2ada-4bd4-8ed2-1a8cb83a9ae4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:28.698101 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5c70ab1d-2ada-4bd4-8ed2-1a8cb83a9ae4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:28.698933 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5c70ab1d-2ada-4bd4-8ed2-1a8cb83a9ae4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:28.699582 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5c70ab1d-2ada-4bd4-8ed2-1a8cb83a9ae4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:28.722107 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-5c70ab1d-2ada-4bd4-8ed2-1a8cb83a9ae4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] HTTP exception thrown: Instance b86888c8-bdd2-468d-a602-67b4f27fb7af could not be found. May 13 13:30:28.725450 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5c70ab1d-2ada-4bd4-8ed2-1a8cb83a9ae4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Request method failure captured: May 13 13:30:28.725450 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af HTTP/1.1 May 13 13:30:28.725450 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:30:28.725450 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:30:28.725450 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:30:28.725450 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:30:28.725450 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:30:28.725450 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:30:28.725450 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:30:28.725450 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:30:28.725450 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiflwBMboKTbh58LY9MV46SCnkvCoDA8Lz7MKk4gwRCoxQPs10Nennf59WSFpA35k2_OuVUqc3Ildqh9KXOiYz1kwf-o_5U0rFqJBoVhvd5RC1KNKMiAiCN3X4-U5A2Z5o8ov4tv4DHgjoV-mWgbm8gyYcnkReiO1lr3jQvWIeRv7-V3g May 13 13:30:28.725450 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:30:28.725450 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:30:28.725450 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:30:28.725450 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:30:28.725450 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:30:28.725450 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:30:28.725450 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:30:28.725450 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:30:28.725450 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:30:28.725450 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:30:28.727077 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2c900748e271404bb3cb11fb2308e784", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2c900748e271404bb3cb11fb2308e784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2c900748e271404bb3cb11fb2308e784"}]}] May 13 13:30:28.727077 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:30:28.727077 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 2c900748e271404bb3cb11fb2308e784 May 13 13:30:28.727077 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1147632152 May 13 13:30:28.727077 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:30:28.727077 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:30:28.727077 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:30:28.727077 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: e25df7c837584b19afe274f6edfb8efd May 13 13:30:28.727077 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeNegativeTest-1147632152-project May 13 13:30:28.727077 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: > May 13 13:30:28.727077 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Instance b86888c8-bdd2-468d-a602-67b4f27fb7af could not be found. May 13 13:30:28.727077 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': 'b86888c8-bdd2-468d-a602-67b4f27fb7af'} May 13 13:30:28.728065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:30:28.728065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:28.728065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:30:28.728065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:30:28.728065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:30:28.728065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:30:28.728065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:30:28.728065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:30:28.728065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:30:28.728065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:30:28.728065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b86888c8-bdd2-468d-a602-67b4f27fb7af could not be found. May 13 13:30:28.728065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:28.728065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:28.728065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:28.728065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:28.728065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:28.728065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:28.728065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:30:28.728065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:30:28.728065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:30:28.730944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:30:28.730944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:30:28.730944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:30:28.730944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:30:28.730944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:30:28.730944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:30:28.730944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:30:28.730944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b86888c8-bdd2-468d-a602-67b4f27fb7af could not be found. May 13 13:30:28.730944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:28.730944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:28.730944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:28.730944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:28.730944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:28.730944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:28.730944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:30:28.730944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:30:28.730944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b86888c8-bdd2-468d-a602-67b4f27fb7af could not be found. May 13 13:30:28.730944 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:28.733862 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5c70ab1d-2ada-4bd4-8ed2-1a8cb83a9ae4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] Returning 404 to user: Instance b86888c8-bdd2-468d-a602-67b4f27fb7af could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:30:28.734929 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5c70ab1d-2ada-4bd4-8ed2-1a8cb83a9ae4 tempest-AttachVolumeNegativeTest-1147632152 tempest-AttachVolumeNegativeTest-1147632152-project] 10.222.0.13 "GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af" status: 404 len: 111 microversion: 2.1 time: 0.057779 May 13 13:30:28.735572 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 445/868] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:28 2022] GET /compute/v2.1/servers/b86888c8-bdd2-468d-a602-67b4f27fb7af => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:30:29.021983 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0201d714-39d2-4eb0-a735-e8b36e0f9363 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:29.024785 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0201d714-39d2-4eb0-a735-e8b36e0f9363 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:29.038122 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0201d714-39d2-4eb0-a735-e8b36e0f9363 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:29.038608 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0201d714-39d2-4eb0-a735-e8b36e0f9363 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:29.039752 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0201d714-39d2-4eb0-a735-e8b36e0f9363 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:29.040391 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0201d714-39d2-4eb0-a735-e8b36e0f9363 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:29.113028 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0201d714-39d2-4eb0-a735-e8b36e0f9363 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:29.113744 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0201d714-39d2-4eb0-a735-e8b36e0f9363 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:29.114571 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-0201d714-39d2-4eb0-a735-e8b36e0f9363 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lazy-loading 'fault' on Instance uuid 274c20ca-135a-48d9-85e5-7c99cf77f68d {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:30:29.178340 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0201d714-39d2-4eb0-a735-e8b36e0f9363 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:29.188382 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0201d714-39d2-4eb0-a735-e8b36e0f9363 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:29.190738 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0201d714-39d2-4eb0-a735-e8b36e0f9363 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbbf4d7cd80146458e33ace6cbbe9594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99575e3d89514f96b2f6f9d871ba0792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:29.205677 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0201d714-39d2-4eb0-a735-e8b36e0f9363 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 200 len: 1371 microversion: 2.20 time: 0.187516 May 13 13:30:29.206770 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 424/869] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:30:29 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:30:29.406291 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e2d41d0e-961f-4c1c-8d8f-0779861e7fd0 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:29.407331 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e2d41d0e-961f-4c1c-8d8f-0779861e7fd0 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:29.415198 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e2d41d0e-961f-4c1c-8d8f-0779861e7fd0 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:29.415802 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e2d41d0e-961f-4c1c-8d8f-0779861e7fd0 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:29.416674 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e2d41d0e-961f-4c1c-8d8f-0779861e7fd0 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:29.417402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e2d41d0e-961f-4c1c-8d8f-0779861e7fd0 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:29.713539 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e2d41d0e-961f-4c1c-8d8f-0779861e7fd0 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:29.724036 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e2d41d0e-961f-4c1c-8d8f-0779861e7fd0 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1569 microversion: 2.1 time: 0.322551 May 13 13:30:29.725235 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 446/870] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:29 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1569 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:30.227199 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-815ab567-a7c2-45a9-9e9d-cfe77d48655d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:30.229578 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-815ab567-a7c2-45a9-9e9d-cfe77d48655d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:30.237176 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-815ab567-a7c2-45a9-9e9d-cfe77d48655d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:30.237627 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-815ab567-a7c2-45a9-9e9d-cfe77d48655d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:30.238493 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-815ab567-a7c2-45a9-9e9d-cfe77d48655d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:30.238922 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-815ab567-a7c2-45a9-9e9d-cfe77d48655d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:30.258119 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-815ab567-a7c2-45a9-9e9d-cfe77d48655d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] HTTP exception thrown: Instance 274c20ca-135a-48d9-85e5-7c99cf77f68d could not be found. May 13 13:30:30.260132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-815ab567-a7c2-45a9-9e9d-cfe77d48655d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Request method failure captured: May 13 13:30:30.260132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d HTTP/1.1 May 13 13:30:30.260132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept: application/json May 13 13:30:30.260132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity May 13 13:30:30.260132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Connection: close May 13 13:30:30.260132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Length: 0 May 13 13:30:30.260132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Type: application/json May 13 13:30:30.260132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Host: 10.222.0.13 May 13 13:30:30.260132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None May 13 13:30:30.260132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 May 13 13:30:30.260132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiflvCuexKDwWzS0mahnmFq7oK9PV0UsmMNMAwnsdXMncXdm0zgwqauUJ7HXKWgw7vY_9I6r-HpUMK0Dojb4Hnu8l2mseakiywyvSYX8lFqUDFhwQXlwcCFf_5QC0JneN1-i2JCHEl6ZR5oIZV7yKZdQvi0m9przSh_84p6HPp7etHHHQ May 13 13:30:30.260132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Id: None May 13 13:30:30.260132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Name: None May 13 13:30:30.260132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed May 13 13:30:30.260132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True May 13 13:30:30.260132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Openstack-Nova-Api-Version: 2.20 May 13 13:30:30.260132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default May 13 13:30:30.260132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default May 13 13:30:30.260132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Id: 99575e3d89514f96b2f6f9d871ba0792 May 13 13:30:30.260132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1322049744 May 13 13:30:30.260132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Role: member,reader May 13 13:30:30.260132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Roles: member,reader May 13 13:30:30.261758 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99575e3d89514f96b2f6f9d871ba0792", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99575e3d89514f96b2f6f9d871ba0792"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99575e3d89514f96b2f6f9d871ba0792"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99575e3d89514f96b2f6f9d871ba0792"}]}] May 13 13:30:30.261758 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1322049744 May 13 13:30:30.261758 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 99575e3d89514f96b2f6f9d871ba0792 May 13 13:30:30.261758 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1322049744 May 13 13:30:30.261758 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User: tempest-AttachVolumeShelveTestJSON-1322049744-project May 13 13:30:30.261758 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default May 13 13:30:30.261758 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default May 13 13:30:30.261758 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Id: cbbf4d7cd80146458e33ace6cbbe9594 May 13 13:30:30.261758 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1322049744-project May 13 13:30:30.261758 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: method: > May 13 13:30:30.261758 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: exception: Instance 274c20ca-135a-48d9-85e5-7c99cf77f68d could not be found. May 13 13:30:30.261758 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: action_args: {'id': '274c20ca-135a-48d9-85e5-7c99cf77f68d'} May 13 13:30:30.262655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:30:30.262655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:30.262655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:30:30.262655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:30:30.262655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:30:30.262655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:30:30.262655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:30:30.262655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:30:30.262655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:30:30.262655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:30:30.262655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 274c20ca-135a-48d9-85e5-7c99cf77f68d could not be found. May 13 13:30:30.262655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:30.262655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:30.262655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:30.262655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:30.262655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:30.262655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:30.262655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:30:30.262655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:30:30.262655 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:30:30.264090 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:30:30.264090 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:30:30.264090 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:30:30.264090 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:30:30.264090 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:30:30.264090 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:30:30.264090 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:30:30.264090 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 274c20ca-135a-48d9-85e5-7c99cf77f68d could not be found. May 13 13:30:30.264090 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:30.264090 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:30.264090 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:30.264090 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:30.264090 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:30.264090 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:30.264090 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:30:30.264090 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:30:30.264090 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 274c20ca-135a-48d9-85e5-7c99cf77f68d could not be found. May 13 13:30:30.264090 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:30.265507 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-815ab567-a7c2-45a9-9e9d-cfe77d48655d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Returning 404 to user: Instance 274c20ca-135a-48d9-85e5-7c99cf77f68d could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:30:30.265507 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-815ab567-a7c2-45a9-9e9d-cfe77d48655d tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 404 len: 111 microversion: 2.20 time: 0.040554 May 13 13:30:30.265507 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 425/871] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:30:30 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 13:30:30.273958 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8debd470-8149-44eb-9c8e-cb70605cac6a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '.version_select at 0x7fb08943c0d0>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:30.394790 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8debd470-8149-44eb-9c8e-cb70605cac6a tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-806290900" status: 204 len: 0 microversion: 2.20 time: 0.125766 May 13 13:30:30.395437 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 447/872] 10.222.0.13 () {60 vars in 1258 bytes} [Fri May 13 13:30:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-806290900 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 13:30:30.753126 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3343cd5f-6272-40e7-88af-d3b92c8657ab tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:30.753801 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3343cd5f-6272-40e7-88af-d3b92c8657ab tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:30.760901 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3343cd5f-6272-40e7-88af-d3b92c8657ab tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:30.761701 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3343cd5f-6272-40e7-88af-d3b92c8657ab tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:30.762796 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3343cd5f-6272-40e7-88af-d3b92c8657ab tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:30.763961 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3343cd5f-6272-40e7-88af-d3b92c8657ab tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:31.086833 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3343cd5f-6272-40e7-88af-d3b92c8657ab tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:31.100488 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3343cd5f-6272-40e7-88af-d3b92c8657ab tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1569 microversion: 2.1 time: 0.362809 May 13 13:30:31.102235 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 426/873] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:30 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1569 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:32.123737 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-587768e7-2def-4274-990c-c46e42873dc0 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:32.129730 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-587768e7-2def-4274-990c-c46e42873dc0 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:32.137132 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-587768e7-2def-4274-990c-c46e42873dc0 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:32.137960 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-587768e7-2def-4274-990c-c46e42873dc0 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:32.139593 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-587768e7-2def-4274-990c-c46e42873dc0 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:32.141284 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-587768e7-2def-4274-990c-c46e42873dc0 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:32.393457 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-587768e7-2def-4274-990c-c46e42873dc0 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:32.405349 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-587768e7-2def-4274-990c-c46e42873dc0 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1569 microversion: 2.1 time: 0.284817 May 13 13:30:32.406924 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 448/874] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:32 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1569 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:33.423791 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-24d103be-bde7-4260-b7e8-625438b7000a tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:33.425079 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-24d103be-bde7-4260-b7e8-625438b7000a tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:33.437144 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-24d103be-bde7-4260-b7e8-625438b7000a tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:33.437810 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-24d103be-bde7-4260-b7e8-625438b7000a tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:33.438880 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-24d103be-bde7-4260-b7e8-625438b7000a tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:33.439484 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-24d103be-bde7-4260-b7e8-625438b7000a tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:33.475218 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e0e0ac38-2092-4bc6-95ae-42e5862699fb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:33.475751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e0e0ac38-2092-4bc6-95ae-42e5862699fb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:33.510181 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e0e0ac38-2092-4bc6-95ae-42e5862699fb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:33.510181 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e0e0ac38-2092-4bc6-95ae-42e5862699fb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:33.510181 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e0e0ac38-2092-4bc6-95ae-42e5862699fb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:33.510181 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e0e0ac38-2092-4bc6-95ae-42e5862699fb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:33.532238 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-e0e0ac38-2092-4bc6-95ae-42e5862699fb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] HTTP exception thrown: Instance 274c20ca-135a-48d9-85e5-7c99cf77f68d could not be found. May 13 13:30:33.534188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e0e0ac38-2092-4bc6-95ae-42e5862699fb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Request method failure captured: May 13 13:30:33.534188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: DELETE /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d HTTP/1.1 May 13 13:30:33.534188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:30:33.534188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:30:33.534188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:30:33.534188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:30:33.534188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:30:33.534188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:30:33.534188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:30:33.534188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:30:33.534188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiflvCuexKDwWzS0mahnmFq7oK9PV0UsmMNMAwnsdXMncXdm0zgwqauUJ7HXKWgw7vY_9I6r-HpUMK0Dojb4Hnu8l2mseakiywyvSYX8lFqUDFhwQXlwcCFf_5QC0JneN1-i2JCHEl6ZR5oIZV7yKZdQvi0m9przSh_84p6HPp7etHHHQ May 13 13:30:33.534188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:30:33.534188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:30:33.534188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:30:33.534188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:30:33.534188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Openstack-Nova-Api-Version: 2.20 May 13 13:30:33.534188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:30:33.534188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:30:33.534188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: 99575e3d89514f96b2f6f9d871ba0792 May 13 13:30:33.534188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1322049744 May 13 13:30:33.534188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:30:33.534188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:30:33.536023 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99575e3d89514f96b2f6f9d871ba0792", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99575e3d89514f96b2f6f9d871ba0792"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99575e3d89514f96b2f6f9d871ba0792"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99575e3d89514f96b2f6f9d871ba0792"}]}] May 13 13:30:33.536023 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1322049744 May 13 13:30:33.536023 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 99575e3d89514f96b2f6f9d871ba0792 May 13 13:30:33.536023 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1322049744 May 13 13:30:33.536023 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeShelveTestJSON-1322049744-project May 13 13:30:33.536023 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:30:33.536023 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:30:33.536023 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: cbbf4d7cd80146458e33ace6cbbe9594 May 13 13:30:33.536023 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1322049744-project May 13 13:30:33.536023 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: > May 13 13:30:33.536023 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Instance 274c20ca-135a-48d9-85e5-7c99cf77f68d could not be found. May 13 13:30:33.536023 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': '274c20ca-135a-48d9-85e5-7c99cf77f68d'} May 13 13:30:33.536893 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:30:33.536893 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:33.536893 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:30:33.536893 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:30:33.536893 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:30:33.536893 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:30:33.536893 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:30:33.536893 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:30:33.536893 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:30:33.536893 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:30:33.536893 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 274c20ca-135a-48d9-85e5-7c99cf77f68d could not be found. May 13 13:30:33.536893 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:33.536893 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:33.536893 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:33.536893 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:33.536893 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:33.536893 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:33.536893 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:30:33.536893 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:30:33.536893 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:30:33.538355 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:30:33.538355 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:30:33.538355 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:30:33.538355 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:30:33.538355 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:30:33.538355 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:30:33.538355 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:30:33.538355 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:30:33.538355 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:30:33.538355 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 274c20ca-135a-48d9-85e5-7c99cf77f68d could not be found. May 13 13:30:33.538355 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:33.538355 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:33.538355 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:33.538355 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:33.538355 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:33.538355 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:33.538355 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:30:33.538355 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:30:33.538355 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 274c20ca-135a-48d9-85e5-7c99cf77f68d could not be found. May 13 13:30:33.538355 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:33.540785 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e0e0ac38-2092-4bc6-95ae-42e5862699fb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Returning 404 to user: Instance 274c20ca-135a-48d9-85e5-7c99cf77f68d could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:30:33.542065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e0e0ac38-2092-4bc6-95ae-42e5862699fb tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "DELETE /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 404 len: 111 microversion: 2.20 time: 0.072566 May 13 13:30:33.543149 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 449/875] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 13 13:30:33 2022] DELETE /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 13:30:33.559630 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-62d11015-ca69-4215-83f8-2a98e130c26e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:33.560921 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-62d11015-ca69-4215-83f8-2a98e130c26e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 274c20ca-135a-48d9-85e5-7c99cf77f68d] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:33.575232 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-62d11015-ca69-4215-83f8-2a98e130c26e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:33.579296 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-62d11015-ca69-4215-83f8-2a98e130c26e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:33.582745 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-62d11015-ca69-4215-83f8-2a98e130c26e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:33.586098 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-62d11015-ca69-4215-83f8-2a98e130c26e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:33.618134 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-62d11015-ca69-4215-83f8-2a98e130c26e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] HTTP exception thrown: Instance 274c20ca-135a-48d9-85e5-7c99cf77f68d could not be found. May 13 13:30:33.622805 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-62d11015-ca69-4215-83f8-2a98e130c26e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Request method failure captured: May 13 13:30:33.622805 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d HTTP/1.1 May 13 13:30:33.622805 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:30:33.622805 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:30:33.622805 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:30:33.622805 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:30:33.622805 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:30:33.622805 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:30:33.622805 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:30:33.622805 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:30:33.622805 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiflvCuexKDwWzS0mahnmFq7oK9PV0UsmMNMAwnsdXMncXdm0zgwqauUJ7HXKWgw7vY_9I6r-HpUMK0Dojb4Hnu8l2mseakiywyvSYX8lFqUDFhwQXlwcCFf_5QC0JneN1-i2JCHEl6ZR5oIZV7yKZdQvi0m9przSh_84p6HPp7etHHHQ May 13 13:30:33.622805 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:30:33.622805 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:30:33.622805 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:30:33.622805 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:30:33.622805 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Openstack-Nova-Api-Version: 2.20 May 13 13:30:33.622805 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:30:33.622805 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:30:33.622805 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: 99575e3d89514f96b2f6f9d871ba0792 May 13 13:30:33.622805 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1322049744 May 13 13:30:33.622805 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:30:33.622805 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:30:33.624378 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99575e3d89514f96b2f6f9d871ba0792", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99575e3d89514f96b2f6f9d871ba0792"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99575e3d89514f96b2f6f9d871ba0792"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99575e3d89514f96b2f6f9d871ba0792"}]}] May 13 13:30:33.624378 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1322049744 May 13 13:30:33.624378 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 99575e3d89514f96b2f6f9d871ba0792 May 13 13:30:33.624378 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1322049744 May 13 13:30:33.624378 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeShelveTestJSON-1322049744-project May 13 13:30:33.624378 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:30:33.624378 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:30:33.624378 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: cbbf4d7cd80146458e33ace6cbbe9594 May 13 13:30:33.624378 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1322049744-project May 13 13:30:33.624378 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: > May 13 13:30:33.624378 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Instance 274c20ca-135a-48d9-85e5-7c99cf77f68d could not be found. May 13 13:30:33.624378 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': '274c20ca-135a-48d9-85e5-7c99cf77f68d'} May 13 13:30:33.625128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:30:33.625128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:33.625128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:30:33.625128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:30:33.625128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:30:33.625128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:30:33.625128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:30:33.625128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:30:33.625128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:30:33.625128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:30:33.625128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 274c20ca-135a-48d9-85e5-7c99cf77f68d could not be found. May 13 13:30:33.625128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:33.625128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:33.625128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:33.625128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:33.625128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:33.625128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:33.625128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:30:33.625128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:30:33.625128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:30:33.627309 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:30:33.627309 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:30:33.627309 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:30:33.627309 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:30:33.627309 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:30:33.627309 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:30:33.627309 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:30:33.627309 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 274c20ca-135a-48d9-85e5-7c99cf77f68d could not be found. May 13 13:30:33.627309 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:33.627309 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:33.627309 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:33.627309 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:33.627309 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:33.627309 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:33.627309 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:30:33.627309 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:30:33.627309 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 274c20ca-135a-48d9-85e5-7c99cf77f68d could not be found. May 13 13:30:33.627309 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:30:33.630525 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-62d11015-ca69-4215-83f8-2a98e130c26e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Returning 404 to user: Instance 274c20ca-135a-48d9-85e5-7c99cf77f68d could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:30:33.634372 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-62d11015-ca69-4215-83f8-2a98e130c26e tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d" status: 404 len: 111 microversion: 2.20 time: 0.084619 May 13 13:30:33.635222 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 450/876] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:30:33 2022] GET /compute/v2.1/servers/274c20ca-135a-48d9-85e5-7c99cf77f68d => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 13:30:33.713443 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-24d103be-bde7-4260-b7e8-625438b7000a tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:33.723569 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-24d103be-bde7-4260-b7e8-625438b7000a tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1569 microversion: 2.1 time: 0.303924 May 13 13:30:33.724155 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 427/877] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:33 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1569 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:34.743197 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2b9c332b-5d55-4e11-ae42-b6d3b3f8d8e7 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:34.746567 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2b9c332b-5d55-4e11-ae42-b6d3b3f8d8e7 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:34.766839 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2b9c332b-5d55-4e11-ae42-b6d3b3f8d8e7 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:34.770810 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2b9c332b-5d55-4e11-ae42-b6d3b3f8d8e7 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:34.773018 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2b9c332b-5d55-4e11-ae42-b6d3b3f8d8e7 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:34.773664 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2b9c332b-5d55-4e11-ae42-b6d3b3f8d8e7 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:35.085893 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-64085548-e6b4-4d41-8a2e-07ed347f9bc9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:35.086580 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-64085548-e6b4-4d41-8a2e-07ed347f9bc9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:35.101908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-64085548-e6b4-4d41-8a2e-07ed347f9bc9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:35.103428 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-64085548-e6b4-4d41-8a2e-07ed347f9bc9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:35.103428 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-64085548-e6b4-4d41-8a2e-07ed347f9bc9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:35.103691 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-64085548-e6b4-4d41-8a2e-07ed347f9bc9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:35.125768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-64085548-e6b4-4d41-8a2e-07ed347f9bc9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] HTTP exception thrown: Instance 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 could not be found. May 13 13:30:35.127505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-64085548-e6b4-4d41-8a2e-07ed347f9bc9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Request method failure captured: May 13 13:30:35.127505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: request: DELETE /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 HTTP/1.1 May 13 13:30:35.127505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept: application/json May 13 13:30:35.127505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity May 13 13:30:35.127505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Connection: close May 13 13:30:35.127505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Length: 0 May 13 13:30:35.127505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Type: application/json May 13 13:30:35.127505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Host: 10.222.0.13 May 13 13:30:35.127505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None May 13 13:30:35.127505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 May 13 13:30:35.127505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiflvCuexKDwWzS0mahnmFq7oK9PV0UsmMNMAwnsdXMncXdm0zgwqauUJ7HXKWgw7vY_9I6r-HpUMK0Dojb4Hnu8l2mseakiywyvSYX8lFqUDFhwQXlwcCFf_5QC0JneN1-i2JCHEl6ZR5oIZV7yKZdQvi0m9przSh_84p6HPp7etHHHQ May 13 13:30:35.127505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Id: None May 13 13:30:35.127505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Name: None May 13 13:30:35.127505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed May 13 13:30:35.127505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True May 13 13:30:35.127505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Openstack-Nova-Api-Version: 2.20 May 13 13:30:35.127505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default May 13 13:30:35.127505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default May 13 13:30:35.127505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Id: 99575e3d89514f96b2f6f9d871ba0792 May 13 13:30:35.127505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1322049744 May 13 13:30:35.127505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Role: member,reader May 13 13:30:35.127505 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Roles: member,reader May 13 13:30:35.129030 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99575e3d89514f96b2f6f9d871ba0792", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99575e3d89514f96b2f6f9d871ba0792"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99575e3d89514f96b2f6f9d871ba0792"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99575e3d89514f96b2f6f9d871ba0792"}]}] May 13 13:30:35.129030 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1322049744 May 13 13:30:35.129030 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 99575e3d89514f96b2f6f9d871ba0792 May 13 13:30:35.129030 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1322049744 May 13 13:30:35.129030 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User: tempest-AttachVolumeShelveTestJSON-1322049744-project May 13 13:30:35.129030 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default May 13 13:30:35.129030 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default May 13 13:30:35.129030 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Id: cbbf4d7cd80146458e33ace6cbbe9594 May 13 13:30:35.129030 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1322049744-project May 13 13:30:35.129030 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: method: > May 13 13:30:35.129030 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: exception: Instance 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 could not be found. May 13 13:30:35.129030 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: action_args: {'id': '0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6'} May 13 13:30:35.129970 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:30:35.129970 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:35.129970 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:30:35.129970 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:30:35.129970 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:30:35.129970 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:30:35.129970 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:30:35.129970 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:30:35.129970 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:30:35.129970 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:30:35.129970 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 could not be found. May 13 13:30:35.129970 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:35.129970 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:35.129970 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:35.129970 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:35.129970 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:35.129970 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:35.129970 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:30:35.129970 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:30:35.129970 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:30:35.131298 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:30:35.131298 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:30:35.131298 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:30:35.131298 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:30:35.131298 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:30:35.131298 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:30:35.131298 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:30:35.131298 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:30:35.131298 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:30:35.131298 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 could not be found. May 13 13:30:35.131298 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:35.131298 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:35.131298 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:35.131298 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:35.131298 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:35.131298 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:35.131298 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:30:35.131298 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:30:35.131298 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 could not be found. May 13 13:30:35.131298 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:35.134094 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-64085548-e6b4-4d41-8a2e-07ed347f9bc9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Returning 404 to user: Instance 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:30:35.140827 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-64085548-e6b4-4d41-8a2e-07ed347f9bc9 tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 404 len: 111 microversion: 2.20 time: 0.058294 May 13 13:30:35.142050 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 428/878] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 13 13:30:35 2022] DELETE /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 13:30:35.152226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-020de509-cb0b-422f-bd1d-a8e54d76af0b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:35.153264 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-020de509-cb0b-422f-bd1d-a8e54d76af0b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] [instance: 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:35.164606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-020de509-cb0b-422f-bd1d-a8e54d76af0b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:35.165060 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-020de509-cb0b-422f-bd1d-a8e54d76af0b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:35.169857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-020de509-cb0b-422f-bd1d-a8e54d76af0b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:35.169857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-020de509-cb0b-422f-bd1d-a8e54d76af0b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:35.203023 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2b9c332b-5d55-4e11-ae42-b6d3b3f8d8e7 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:35.220508 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2b9c332b-5d55-4e11-ae42-b6d3b3f8d8e7 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1569 microversion: 2.1 time: 0.482463 May 13 13:30:35.227858 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-020de509-cb0b-422f-bd1d-a8e54d76af0b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] HTTP exception thrown: Instance 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 could not be found. May 13 13:30:35.227997 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 451/879] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:34 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1569 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:35.228081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-020de509-cb0b-422f-bd1d-a8e54d76af0b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Request method failure captured: May 13 13:30:35.228081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 HTTP/1.1 May 13 13:30:35.228081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept: application/json May 13 13:30:35.228081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity May 13 13:30:35.228081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Connection: close May 13 13:30:35.228081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Length: 0 May 13 13:30:35.228081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Type: application/json May 13 13:30:35.228081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Host: 10.222.0.13 May 13 13:30:35.228081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None May 13 13:30:35.228081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 May 13 13:30:35.228081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiflvCuexKDwWzS0mahnmFq7oK9PV0UsmMNMAwnsdXMncXdm0zgwqauUJ7HXKWgw7vY_9I6r-HpUMK0Dojb4Hnu8l2mseakiywyvSYX8lFqUDFhwQXlwcCFf_5QC0JneN1-i2JCHEl6ZR5oIZV7yKZdQvi0m9przSh_84p6HPp7etHHHQ May 13 13:30:35.228081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Id: None May 13 13:30:35.228081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Name: None May 13 13:30:35.228081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed May 13 13:30:35.228081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True May 13 13:30:35.228081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Openstack-Nova-Api-Version: 2.20 May 13 13:30:35.228081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default May 13 13:30:35.228081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default May 13 13:30:35.228081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Id: 99575e3d89514f96b2f6f9d871ba0792 May 13 13:30:35.228081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1322049744 May 13 13:30:35.228081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Role: member,reader May 13 13:30:35.228081 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Roles: member,reader May 13 13:30:35.229383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99575e3d89514f96b2f6f9d871ba0792", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99575e3d89514f96b2f6f9d871ba0792"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99575e3d89514f96b2f6f9d871ba0792"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99575e3d89514f96b2f6f9d871ba0792"}]}] May 13 13:30:35.229383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1322049744 May 13 13:30:35.229383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 99575e3d89514f96b2f6f9d871ba0792 May 13 13:30:35.229383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1322049744 May 13 13:30:35.229383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User: tempest-AttachVolumeShelveTestJSON-1322049744-project May 13 13:30:35.229383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default May 13 13:30:35.229383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default May 13 13:30:35.229383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Id: cbbf4d7cd80146458e33ace6cbbe9594 May 13 13:30:35.229383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1322049744-project May 13 13:30:35.229383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: method: > May 13 13:30:35.229383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: exception: Instance 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 could not be found. May 13 13:30:35.229383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: action_args: {'id': '0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6'} May 13 13:30:35.230463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:30:35.230463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:35.230463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:30:35.230463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:30:35.230463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:30:35.230463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:30:35.230463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:30:35.230463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:30:35.230463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:30:35.230463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:30:35.230463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 could not be found. May 13 13:30:35.230463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:35.230463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:35.230463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:35.230463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:35.230463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:35.230463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:35.230463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:30:35.230463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:30:35.230463 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:30:35.232523 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:30:35.232523 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:30:35.232523 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:30:35.232523 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:30:35.232523 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:30:35.232523 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:30:35.232523 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:30:35.232523 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 could not be found. May 13 13:30:35.232523 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:35.232523 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:35.232523 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:35.232523 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:35.232523 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:35.232523 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:35.232523 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:30:35.232523 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:30:35.232523 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 could not be found. May 13 13:30:35.232523 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:30:35.236223 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-020de509-cb0b-422f-bd1d-a8e54d76af0b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] Returning 404 to user: Instance 0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:30:35.236223 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-020de509-cb0b-422f-bd1d-a8e54d76af0b tempest-AttachVolumeShelveTestJSON-1322049744 tempest-AttachVolumeShelveTestJSON-1322049744-project] 10.222.0.13 "GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6" status: 404 len: 111 microversion: 2.20 time: 0.077814 May 13 13:30:35.236223 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 429/880] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 13 13:30:35 2022] GET /compute/v2.1/servers/0fa642dd-f26e-4bd2-9ab3-2ad4d960a3c6 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 13:30:36.239760 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-fadc40f7-9a68-45fe-a210-195ace3b6ad9 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:36.241478 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-fadc40f7-9a68-45fe-a210-195ace3b6ad9 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:36.264041 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fadc40f7-9a68-45fe-a210-195ace3b6ad9 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:36.267443 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fadc40f7-9a68-45fe-a210-195ace3b6ad9 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:36.267443 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fadc40f7-9a68-45fe-a210-195ace3b6ad9 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:36.267976 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fadc40f7-9a68-45fe-a210-195ace3b6ad9 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:36.689582 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-fadc40f7-9a68-45fe-a210-195ace3b6ad9 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:36.705651 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-fadc40f7-9a68-45fe-a210-195ace3b6ad9 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1570 microversion: 2.1 time: 0.469216 May 13 13:30:36.721714 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 452/881] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:36 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1570 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:36.726957 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4930f6b4-4a55-44f4-95a7-24106b171431 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:30:36.727534 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4930f6b4-4a55-44f4-95a7-24106b171431 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:36.748042 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4930f6b4-4a55-44f4-95a7-24106b171431 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:36.750642 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4930f6b4-4a55-44f4-95a7-24106b171431 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:36.752758 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4930f6b4-4a55-44f4-95a7-24106b171431 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:36.753431 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4930f6b4-4a55-44f4-95a7-24106b171431 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:37.329647 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4930f6b4-4a55-44f4-95a7-24106b171431 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "POST /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511/action" status: 202 len: 0 microversion: 2.1 time: 0.606701 May 13 13:30:37.336094 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 430/882] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 13 13:30:36 2022] POST /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511/action => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:30:37.344830 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d90b26a7-9a53-4fb1-8576-8a346ae2cab2 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:37.346866 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d90b26a7-9a53-4fb1-8576-8a346ae2cab2 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:37.364339 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d90b26a7-9a53-4fb1-8576-8a346ae2cab2 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:37.365833 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d90b26a7-9a53-4fb1-8576-8a346ae2cab2 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:37.369977 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d90b26a7-9a53-4fb1-8576-8a346ae2cab2 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:37.370467 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d90b26a7-9a53-4fb1-8576-8a346ae2cab2 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:37.771358 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-baf06069-90cc-425e-9615-f5aa88104fdd req-80d1b5a0-4d1a-48f2-b78c-b078f59d5fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f4be22-416d-4465-9e39-d09271f63511", "name": "network-vif-unplugged", "status": "completed", "tag": "7ceff24a-7ce2-4184-bc2c-ed2f493ac946"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:30:37.802965 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-baf06069-90cc-425e-9615-f5aa88104fdd req-80d1b5a0-4d1a-48f2-b78c-b078f59d5fc5 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:37.802965 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-baf06069-90cc-425e-9615-f5aa88104fdd req-80d1b5a0-4d1a-48f2-b78c-b078f59d5fc5 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:37.821724 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.compute.server_external_events [req-baf06069-90cc-425e-9615-f5aa88104fdd req-80d1b5a0-4d1a-48f2-b78c-b078f59d5fc5 service nova] Unable to find a host for instance 58f4be22-416d-4465-9e39-d09271f63511. Dropping event network-vif-unplugged {{(pid=117720) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 13 13:30:37.824630 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-baf06069-90cc-425e-9615-f5aa88104fdd req-80d1b5a0-4d1a-48f2-b78c-b078f59d5fc5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.058460 May 13 13:30:37.831076 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 431/883] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 65 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 13 13:30:38.079454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d90b26a7-9a53-4fb1-8576-8a346ae2cab2 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:38.098925 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d90b26a7-9a53-4fb1-8576-8a346ae2cab2 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1518 microversion: 2.1 time: 0.759158 May 13 13:30:38.111131 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 453/884] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:37 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1518 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:39.118653 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a8151951-40f2-4111-832f-fb5e306c118b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:39.119896 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a8151951-40f2-4111-832f-fb5e306c118b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:39.131758 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a8151951-40f2-4111-832f-fb5e306c118b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:39.134555 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a8151951-40f2-4111-832f-fb5e306c118b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:39.136670 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a8151951-40f2-4111-832f-fb5e306c118b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:39.139271 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a8151951-40f2-4111-832f-fb5e306c118b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:39.704966 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a8151951-40f2-4111-832f-fb5e306c118b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:39.716848 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a8151951-40f2-4111-832f-fb5e306c118b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1518 microversion: 2.1 time: 0.601522 May 13 13:30:39.729997 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 432/885] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:39 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1518 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:40.738142 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-87d53a40-0e1e-4ab1-8fab-0e1003f087de tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:40.739596 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-87d53a40-0e1e-4ab1-8fab-0e1003f087de tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:40.746853 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-87d53a40-0e1e-4ab1-8fab-0e1003f087de tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:40.747857 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-87d53a40-0e1e-4ab1-8fab-0e1003f087de tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:40.748926 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-87d53a40-0e1e-4ab1-8fab-0e1003f087de tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:40.749592 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-87d53a40-0e1e-4ab1-8fab-0e1003f087de tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:41.218606 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-87d53a40-0e1e-4ab1-8fab-0e1003f087de tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:41.332488 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-87d53a40-0e1e-4ab1-8fab-0e1003f087de tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1520 microversion: 2.1 time: 0.552998 May 13 13:30:41.342408 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 454/886] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:40 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1520 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:42.088919 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ae1f4695-43d1-41ea-8aa0-9c9b041fbdfa tempest-VolumesTestJSON-175448751 tempest-VolumesTestJSON-175448751-project] Calling method '.version_select at 0x7fb0840aa1f0>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:42.160704 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ae1f4695-43d1-41ea-8aa0-9c9b041fbdfa tempest-VolumesTestJSON-175448751 tempest-VolumesTestJSON-175448751-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/edd558ff-1697-4a32-b50f-745a893d2ae4" status: 200 len: 350 microversion: 2.1 time: 0.075439 May 13 13:30:42.168778 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 433/887] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 13 13:30:42 2022] GET /compute/v2.1/os-volumes/edd558ff-1697-4a32-b50f-745a893d2ae4 => generated 350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:30:42.355243 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-83aafd86-253d-45ca-99d3-6720832c592f tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:42.356721 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-83aafd86-253d-45ca-99d3-6720832c592f tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:42.370515 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-83aafd86-253d-45ca-99d3-6720832c592f tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:42.371446 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-83aafd86-253d-45ca-99d3-6720832c592f tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:42.373057 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-83aafd86-253d-45ca-99d3-6720832c592f tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:42.380742 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-83aafd86-253d-45ca-99d3-6720832c592f tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:42.614236 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-83aafd86-253d-45ca-99d3-6720832c592f tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:42.640953 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-83aafd86-253d-45ca-99d3-6720832c592f tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1576 microversion: 2.1 time: 0.271548 May 13 13:30:42.644288 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 455/888] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:42 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1576 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:43.663042 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-11a4d120-ae7a-4838-81c5-339b85b03616 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:43.664621 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-11a4d120-ae7a-4838-81c5-339b85b03616 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:43.679831 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-11a4d120-ae7a-4838-81c5-339b85b03616 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:43.683418 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-11a4d120-ae7a-4838-81c5-339b85b03616 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:43.685774 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-11a4d120-ae7a-4838-81c5-339b85b03616 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:43.687525 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-11a4d120-ae7a-4838-81c5-339b85b03616 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:43.895549 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-11a4d120-ae7a-4838-81c5-339b85b03616 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:43.904583 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-11a4d120-ae7a-4838-81c5-339b85b03616 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1576 microversion: 2.1 time: 0.246773 May 13 13:30:43.915173 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 434/889] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:43 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1576 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:44.133289 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f05774a9-a371-4fe7-9f7c-9e038819686d tempest-VolumesTestJSON-175448751 tempest-VolumesTestJSON-175448751-project] Calling method '.version_select at 0x7fb08948fca0>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:44.189763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f05774a9-a371-4fe7-9f7c-9e038819686d tempest-VolumesTestJSON-175448751 tempest-VolumesTestJSON-175448751-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/1606f06f-e0fe-47b1-8138-236002d9d2a7" status: 200 len: 351 microversion: 2.1 time: 0.065053 May 13 13:30:44.205876 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 456/890] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 13 13:30:44 2022] GET /compute/v2.1/os-volumes/1606f06f-e0fe-47b1-8138-236002d9d2a7 => generated 351 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:30:44.921608 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-eb49f3aa-f132-48b1-a0a6-bd555fbcc581 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:44.923503 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-eb49f3aa-f132-48b1-a0a6-bd555fbcc581 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:44.927514 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-fd8e574d-54f6-4e8b-a251-0b279fb7e0b8 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1120468104", "imageRef": "ece294e8-5415-4d6a-a0d3-a14539c51c0a", "flavorRef": "452"}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:30:44.940520 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eb49f3aa-f132-48b1-a0a6-bd555fbcc581 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:44.940969 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eb49f3aa-f132-48b1-a0a6-bd555fbcc581 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:44.941763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eb49f3aa-f132-48b1-a0a6-bd555fbcc581 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:44.942241 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eb49f3aa-f132-48b1-a0a6-bd555fbcc581 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:44.992938 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.network.neutron [None req-fd8e574d-54f6-4e8b-a251-0b279fb7e0b8 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] validate_networks() for None {{(pid=117720) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:30:45.674556 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-eb49f3aa-f132-48b1-a0a6-bd555fbcc581 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:45.683391 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-eb49f3aa-f132-48b1-a0a6-bd555fbcc581 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1576 microversion: 2.1 time: 0.765621 May 13 13:30:45.684116 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 457/891] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:44 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1576 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:45.759852 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-fd8e574d-54f6-4e8b-a251-0b279fb7e0b8 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Flavor limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:30:45.760267 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-fd8e574d-54f6-4e8b-a251-0b279fb7e0b8 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Image limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:30:45.760734 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-fd8e574d-54f6-4e8b-a251-0b279fb7e0b8 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Flavor pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:30:45.761164 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-fd8e574d-54f6-4e8b-a251-0b279fb7e0b8 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Image pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:30:45.761594 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-fd8e574d-54f6-4e8b-a251-0b279fb7e0b8 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:30:45.771631 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd8e574d-54f6-4e8b-a251-0b279fb7e0b8 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:45.772083 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd8e574d-54f6-4e8b-a251-0b279fb7e0b8 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:45.772876 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd8e574d-54f6-4e8b-a251-0b279fb7e0b8 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:45.773311 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd8e574d-54f6-4e8b-a251-0b279fb7e0b8 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:45.789930 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-fd8e574d-54f6-4e8b-a251-0b279fb7e0b8 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Getting quotas for project 34bb17eb306045cb83c0a1b8e69b500d. Resources: {'cores', 'instances', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:30:45.793974 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-fd8e574d-54f6-4e8b-a251-0b279fb7e0b8 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Getting quotas for user d2295ff56baa424792e45ed742fe1bad and project 34bb17eb306045cb83c0a1b8e69b500d. Resources: {'cores', 'instances', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:30:45.806626 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-fd8e574d-54f6-4e8b-a251-0b279fb7e0b8 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Going to run 1 instances... {{(pid=117720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:30:45.808899 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-fd8e574d-54f6-4e8b-a251-0b279fb7e0b8 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] [instance: b4daf8d5-ea57-459f-b1fb-e6de316e6f19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ece294e8-5415-4d6a-a0d3-a14539c51c0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:30:46.040603 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-fd8e574d-54f6-4e8b-a251-0b279fb7e0b8 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.124045 May 13 13:30:46.052037 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2f005e8b-83d2-49e4-913e-1e5fdc7b6f7a tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:46.052866 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2f005e8b-83d2-49e4-913e-1e5fdc7b6f7a tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] [instance: b4daf8d5-ea57-459f-b1fb-e6de316e6f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:46.054710 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 435/892] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 13 13:30:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:30:46.150765 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2f005e8b-83d2-49e4-913e-1e5fdc7b6f7a tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2295ff56baa424792e45ed742fe1bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bb17eb306045cb83c0a1b8e69b500d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:46.167385 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2f005e8b-83d2-49e4-913e-1e5fdc7b6f7a tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] 10.222.0.13 "GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19" status: 200 len: 1215 microversion: 2.1 time: 0.119185 May 13 13:30:46.168489 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 458/893] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:46 2022] GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19 => generated 1215 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:30:46.219944 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-973a8901-1f78-420e-996c-68e5b02938a4 tempest-VolumesTestJSON-175448751 tempest-VolumesTestJSON-175448751-project] Calling method '.version_select at 0x7fb0840aaf70>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:46.298255 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-973a8901-1f78-420e-996c-68e5b02938a4 tempest-VolumesTestJSON-175448751 tempest-VolumesTestJSON-175448751-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/847cdd59-2ab8-4229-9ebb-82dc2e3e635e" status: 200 len: 351 microversion: 2.1 time: 0.084268 May 13 13:30:46.298879 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 436/894] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 13 13:30:46 2022] GET /compute/v2.1/os-volumes/847cdd59-2ab8-4229-9ebb-82dc2e3e635e => generated 351 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:30:46.311704 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3c07d74d-63d9-4324-b475-ad949cf2a572 tempest-VolumesTestJSON-175448751 tempest-VolumesTestJSON-175448751-project] Calling method '.version_select at 0x7fb08946eb80>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:46.426177 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3c07d74d-63d9-4324-b475-ad949cf2a572 tempest-VolumesTestJSON-175448751 tempest-VolumesTestJSON-175448751-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.119448 May 13 13:30:46.427514 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 459/895] 10.222.0.13 () {58 vars in 1133 bytes} [Fri May 13 13:30:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:46.453217 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-403b84d5-0d3e-4e91-9775-6757a7d240c3 tempest-VolumesTestJSON-175448751 tempest-VolumesTestJSON-175448751-project] Calling method '.version_select at 0x7fb0840b9700>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:46.545975 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-403b84d5-0d3e-4e91-9775-6757a7d240c3 tempest-VolumesTestJSON-175448751 tempest-VolumesTestJSON-175448751-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.104331 May 13 13:30:46.548296 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 437/896] 10.222.0.13 () {58 vars in 1148 bytes} [Fri May 13 13:30:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:30:46.563470 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3a8a453c-039a-4445-b543-8575f754a959 tempest-VolumesTestJSON-175448751 tempest-VolumesTestJSON-175448751-project] Calling method '.version_select at 0x7fb084164670>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:46.691005 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3a8a453c-039a-4445-b543-8575f754a959 tempest-VolumesTestJSON-175448751 tempest-VolumesTestJSON-175448751-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.133549 May 13 13:30:46.694028 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 460/897] 10.222.0.13 () {58 vars in 1133 bytes} [Fri May 13 13:30:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:46.705750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-00b7a0bf-3c66-4ba9-adff-317877221d62 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:46.708884 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-00b7a0bf-3c66-4ba9-adff-317877221d62 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:46.713225 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-96213778-bce7-4dcb-9922-86d2bbc80c0f tempest-VolumesTestJSON-175448751 tempest-VolumesTestJSON-175448751-project] Calling method '.version_select at 0x7fb084131040>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:46.718172 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-00b7a0bf-3c66-4ba9-adff-317877221d62 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:46.718902 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-00b7a0bf-3c66-4ba9-adff-317877221d62 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:46.720098 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-00b7a0bf-3c66-4ba9-adff-317877221d62 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:46.720743 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-00b7a0bf-3c66-4ba9-adff-317877221d62 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:46.837866 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-96213778-bce7-4dcb-9922-86d2bbc80c0f tempest-VolumesTestJSON-175448751 tempest-VolumesTestJSON-175448751-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.135467 May 13 13:30:46.838693 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 461/898] 10.222.0.13 () {58 vars in 1166 bytes} [Fri May 13 13:30:46 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:30:46.854144 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5e0872ad-2dab-4346-8a72-a44e1f80e6fb tempest-VolumesTestJSON-175448751 tempest-VolumesTestJSON-175448751-project] Calling method '.version_select at 0x7fb08948f5e0>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:46.955174 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5e0872ad-2dab-4346-8a72-a44e1f80e6fb tempest-VolumesTestJSON-175448751 tempest-VolumesTestJSON-175448751-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.106875 May 13 13:30:46.964200 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 462/899] 10.222.0.13 () {58 vars in 1169 bytes} [Fri May 13 13:30:46 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:30:46.964815 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-00b7a0bf-3c66-4ba9-adff-317877221d62 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:46.971958 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-bafc8ff5-396c-4b15-ab56-d85b57fd5019 tempest-VolumesTestJSON-175448751 tempest-VolumesTestJSON-175448751-project] Calling method '.version_select at 0x7fb0894a3160>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:46.990514 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-00b7a0bf-3c66-4ba9-adff-317877221d62 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1576 microversion: 2.1 time: 0.292807 May 13 13:30:46.992007 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 438/900] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:46 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1576 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:47.081194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-bafc8ff5-396c-4b15-ab56-d85b57fd5019 tempest-VolumesTestJSON-175448751 tempest-VolumesTestJSON-175448751-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.115574 May 13 13:30:47.085513 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 463/901] 10.222.0.13 () {58 vars in 1154 bytes} [Fri May 13 13:30:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:47.101371 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9ca8d9f6-8de3-46a8-82c9-bb8749d1acca tempest-VolumesTestJSON-175448751 tempest-VolumesTestJSON-175448751-project] Calling method '.version_select at 0x7fb0840aa430>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:47.192960 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e9545959-148c-470c-9317-45b150447ca5 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:47.198933 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e9545959-148c-470c-9317-45b150447ca5 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] [instance: b4daf8d5-ea57-459f-b1fb-e6de316e6f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:47.288632 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9ca8d9f6-8de3-46a8-82c9-bb8749d1acca tempest-VolumesTestJSON-175448751 tempest-VolumesTestJSON-175448751-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.191152 May 13 13:30:47.289908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 439/902] 10.222.0.13 () {58 vars in 1187 bytes} [Fri May 13 13:30:47 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:30:47.309597 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d46ae186-3382-4379-9e1d-4174ee5e21fe tempest-VolumesTestJSON-175448751 tempest-VolumesTestJSON-175448751-project] Calling method '.version_select at 0x7fb0840c8790>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:47.382328 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e9545959-148c-470c-9317-45b150447ca5 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2295ff56baa424792e45ed742fe1bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bb17eb306045cb83c0a1b8e69b500d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:47.394036 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e9545959-148c-470c-9317-45b150447ca5 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] 10.222.0.13 "GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19" status: 200 len: 1215 microversion: 2.1 time: 0.212546 May 13 13:30:47.394657 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 464/903] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:47 2022] GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19 => generated 1215 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:30:47.449340 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d46ae186-3382-4379-9e1d-4174ee5e21fe tempest-VolumesTestJSON-175448751 tempest-VolumesTestJSON-175448751-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.146426 May 13 13:30:47.450227 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 440/904] 10.222.0.13 () {58 vars in 1154 bytes} [Fri May 13 13:30:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:30:48.008683 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-edbb5e5a-9afb-4fbb-b8f5-559986bf7612 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:48.009300 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-edbb5e5a-9afb-4fbb-b8f5-559986bf7612 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:48.030645 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-edbb5e5a-9afb-4fbb-b8f5-559986bf7612 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:48.031365 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-edbb5e5a-9afb-4fbb-b8f5-559986bf7612 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:48.032357 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-edbb5e5a-9afb-4fbb-b8f5-559986bf7612 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:48.034924 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-edbb5e5a-9afb-4fbb-b8f5-559986bf7612 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:48.428956 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-cc809f7f-9559-43a7-8d5a-8fdd443b7a86 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:48.430300 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-cc809f7f-9559-43a7-8d5a-8fdd443b7a86 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] [instance: b4daf8d5-ea57-459f-b1fb-e6de316e6f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:48.431038 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-edbb5e5a-9afb-4fbb-b8f5-559986bf7612 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:48.439831 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-edbb5e5a-9afb-4fbb-b8f5-559986bf7612 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1576 microversion: 2.1 time: 0.434910 May 13 13:30:48.440411 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 465/905] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:48 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1576 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:48.449648 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cc809f7f-9559-43a7-8d5a-8fdd443b7a86 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:48.456150 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cc809f7f-9559-43a7-8d5a-8fdd443b7a86 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:48.457494 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cc809f7f-9559-43a7-8d5a-8fdd443b7a86 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:48.458216 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cc809f7f-9559-43a7-8d5a-8fdd443b7a86 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:48.561592 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-cc809f7f-9559-43a7-8d5a-8fdd443b7a86 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2295ff56baa424792e45ed742fe1bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bb17eb306045cb83c0a1b8e69b500d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:48.583651 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-cc809f7f-9559-43a7-8d5a-8fdd443b7a86 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] 10.222.0.13 "GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19" status: 200 len: 1267 microversion: 2.1 time: 0.168582 May 13 13:30:48.584428 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 441/906] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:48 2022] GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:30:49.457775 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2b2e41c5-bc5a-42cf-8d02-dbe5de78c534 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:49.458863 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2b2e41c5-bc5a-42cf-8d02-dbe5de78c534 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:49.465577 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2b2e41c5-bc5a-42cf-8d02-dbe5de78c534 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:49.471217 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2b2e41c5-bc5a-42cf-8d02-dbe5de78c534 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:49.471217 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2b2e41c5-bc5a-42cf-8d02-dbe5de78c534 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:49.471217 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2b2e41c5-bc5a-42cf-8d02-dbe5de78c534 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:49.602574 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1028bca0-1b63-4acd-8b9a-0544bf81230f tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:49.603889 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1028bca0-1b63-4acd-8b9a-0544bf81230f tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] [instance: b4daf8d5-ea57-459f-b1fb-e6de316e6f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:49.610961 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1028bca0-1b63-4acd-8b9a-0544bf81230f tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:49.611418 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1028bca0-1b63-4acd-8b9a-0544bf81230f tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:49.612344 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1028bca0-1b63-4acd-8b9a-0544bf81230f tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:49.612955 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1028bca0-1b63-4acd-8b9a-0544bf81230f tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:49.706787 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1028bca0-1b63-4acd-8b9a-0544bf81230f tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2295ff56baa424792e45ed742fe1bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bb17eb306045cb83c0a1b8e69b500d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:49.715491 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1028bca0-1b63-4acd-8b9a-0544bf81230f tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] 10.222.0.13 "GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19" status: 200 len: 1285 microversion: 2.1 time: 0.116661 May 13 13:30:49.716670 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 442/907] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:49 2022] GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19 => generated 1285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:49.783170 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2b2e41c5-bc5a-42cf-8d02-dbe5de78c534 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:49.793560 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2b2e41c5-bc5a-42cf-8d02-dbe5de78c534 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1576 microversion: 2.1 time: 0.339628 May 13 13:30:49.794475 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 466/908] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:49 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1576 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:50.735555 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-45ea6ee7-3677-4662-8fb9-acfc6da6c9b7 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:50.736220 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-45ea6ee7-3677-4662-8fb9-acfc6da6c9b7 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] [instance: b4daf8d5-ea57-459f-b1fb-e6de316e6f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:50.744987 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-45ea6ee7-3677-4662-8fb9-acfc6da6c9b7 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:50.745917 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-45ea6ee7-3677-4662-8fb9-acfc6da6c9b7 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:50.747025 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-45ea6ee7-3677-4662-8fb9-acfc6da6c9b7 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:50.749198 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-45ea6ee7-3677-4662-8fb9-acfc6da6c9b7 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:50.811966 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ee73fd07-0fc2-4562-b50c-43f44018bc4d tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:50.813207 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ee73fd07-0fc2-4562-b50c-43f44018bc4d tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:50.820074 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ee73fd07-0fc2-4562-b50c-43f44018bc4d tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:50.820884 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ee73fd07-0fc2-4562-b50c-43f44018bc4d tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:50.822123 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ee73fd07-0fc2-4562-b50c-43f44018bc4d tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:50.822796 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ee73fd07-0fc2-4562-b50c-43f44018bc4d tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:51.061675 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-45ea6ee7-3677-4662-8fb9-acfc6da6c9b7 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2295ff56baa424792e45ed742fe1bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bb17eb306045cb83c0a1b8e69b500d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:51.080156 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-45ea6ee7-3677-4662-8fb9-acfc6da6c9b7 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] 10.222.0.13 "GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19" status: 200 len: 1315 microversion: 2.1 time: 0.350426 May 13 13:30:51.080815 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 443/909] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:50 2022] GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:51.107310 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ee73fd07-0fc2-4562-b50c-43f44018bc4d tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:51.116490 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ee73fd07-0fc2-4562-b50c-43f44018bc4d tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1576 microversion: 2.1 time: 0.309138 May 13 13:30:51.121928 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 467/910] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:50 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1576 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:52.098802 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-629c5cc1-18f7-41c1-a5cb-4fc9c6cbbb53 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:52.100064 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-629c5cc1-18f7-41c1-a5cb-4fc9c6cbbb53 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] [instance: b4daf8d5-ea57-459f-b1fb-e6de316e6f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:52.111134 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-629c5cc1-18f7-41c1-a5cb-4fc9c6cbbb53 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:52.116752 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-629c5cc1-18f7-41c1-a5cb-4fc9c6cbbb53 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:52.116752 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-629c5cc1-18f7-41c1-a5cb-4fc9c6cbbb53 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:52.116752 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-629c5cc1-18f7-41c1-a5cb-4fc9c6cbbb53 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:52.143078 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7aaa2cf6-3296-4ca5-b9e6-5ab7e31e4953 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:52.145970 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7aaa2cf6-3296-4ca5-b9e6-5ab7e31e4953 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:52.161861 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7aaa2cf6-3296-4ca5-b9e6-5ab7e31e4953 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:52.163446 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7aaa2cf6-3296-4ca5-b9e6-5ab7e31e4953 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:52.164994 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7aaa2cf6-3296-4ca5-b9e6-5ab7e31e4953 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:52.167681 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7aaa2cf6-3296-4ca5-b9e6-5ab7e31e4953 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:52.522885 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7aaa2cf6-3296-4ca5-b9e6-5ab7e31e4953 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:52.531385 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7aaa2cf6-3296-4ca5-b9e6-5ab7e31e4953 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1576 microversion: 2.1 time: 0.396659 May 13 13:30:52.541594 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 468/911] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:52 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1576 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:52.583124 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-629c5cc1-18f7-41c1-a5cb-4fc9c6cbbb53 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2295ff56baa424792e45ed742fe1bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bb17eb306045cb83c0a1b8e69b500d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:52.602986 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-629c5cc1-18f7-41c1-a5cb-4fc9c6cbbb53 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] 10.222.0.13 "GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19" status: 200 len: 1315 microversion: 2.1 time: 0.508205 May 13 13:30:52.615278 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 444/912] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:52 2022] GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19 => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:52.852423 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-038ba3b3-ef1a-4bba-b19d-1aa6c7db8151 req-a0260618-0031-4722-84bf-ae8b871f2fcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4daf8d5-ea57-459f-b1fb-e6de316e6f19", "tag": "25145e1a-a6a1-42c7-b0d0-4e1fe4ae001b"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:30:52.879728 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-038ba3b3-ef1a-4bba-b19d-1aa6c7db8151 req-a0260618-0031-4722-84bf-ae8b871f2fcb service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:52.879728 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-038ba3b3-ef1a-4bba-b19d-1aa6c7db8151 req-a0260618-0031-4722-84bf-ae8b871f2fcb service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:52.901028 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-038ba3b3-ef1a-4bba-b19d-1aa6c7db8151 req-a0260618-0031-4722-84bf-ae8b871f2fcb service nova] Creating event network-changed:25145e1a-a6a1-42c7-b0d0-4e1fe4ae001b for instance b4daf8d5-ea57-459f-b1fb-e6de316e6f19 on hv-cinder-84163 May 13 13:30:52.909612 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-038ba3b3-ef1a-4bba-b19d-1aa6c7db8151 req-a0260618-0031-4722-84bf-ae8b871f2fcb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060808 May 13 13:30:52.913959 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 469/913] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:30:53.551864 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5671aab2-292d-451b-8ee6-1847ad88a750 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:53.553367 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5671aab2-292d-451b-8ee6-1847ad88a750 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:53.571333 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5671aab2-292d-451b-8ee6-1847ad88a750 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:53.572224 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5671aab2-292d-451b-8ee6-1847ad88a750 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:53.573358 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5671aab2-292d-451b-8ee6-1847ad88a750 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:53.573811 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5671aab2-292d-451b-8ee6-1847ad88a750 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:53.622458 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-24e0dd0e-d785-4af1-9abd-2f545a10c0b2 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:53.624118 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-24e0dd0e-d785-4af1-9abd-2f545a10c0b2 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] [instance: b4daf8d5-ea57-459f-b1fb-e6de316e6f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:53.635389 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-24e0dd0e-d785-4af1-9abd-2f545a10c0b2 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:53.642616 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-24e0dd0e-d785-4af1-9abd-2f545a10c0b2 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:53.647402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-24e0dd0e-d785-4af1-9abd-2f545a10c0b2 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:53.647402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-24e0dd0e-d785-4af1-9abd-2f545a10c0b2 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:53.939110 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5671aab2-292d-451b-8ee6-1847ad88a750 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:53.954356 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5671aab2-292d-451b-8ee6-1847ad88a750 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1576 microversion: 2.1 time: 0.408872 May 13 13:30:53.966500 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 445/914] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:53 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1576 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:53.972299 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-01871ce2-5490-4415-8416-703194925123 req-3e814f44-d67f-4f23-953a-b2a4a4d2bf5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f4be22-416d-4465-9e39-d09271f63511", "name": "network-vif-plugged", "status": "completed", "tag": "7ceff24a-7ce2-4184-bc2c-ed2f493ac946"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:30:53.981387 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-01871ce2-5490-4415-8416-703194925123 req-3e814f44-d67f-4f23-953a-b2a4a4d2bf5b service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:53.983308 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-01871ce2-5490-4415-8416-703194925123 req-3e814f44-d67f-4f23-953a-b2a4a4d2bf5b service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:53.997016 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-01871ce2-5490-4415-8416-703194925123 req-3e814f44-d67f-4f23-953a-b2a4a4d2bf5b service nova] Creating event network-vif-plugged:7ceff24a-7ce2-4184-bc2c-ed2f493ac946 for instance 58f4be22-416d-4465-9e39-d09271f63511 on hv-cinder-84163 May 13 13:30:54.010095 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-01871ce2-5490-4415-8416-703194925123 req-3e814f44-d67f-4f23-953a-b2a4a4d2bf5b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039776 May 13 13:30:54.012632 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 446/915] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:30:54.045734 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-24e0dd0e-d785-4af1-9abd-2f545a10c0b2 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2295ff56baa424792e45ed742fe1bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bb17eb306045cb83c0a1b8e69b500d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:54.057460 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-24e0dd0e-d785-4af1-9abd-2f545a10c0b2 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] 10.222.0.13 "GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19" status: 200 len: 1315 microversion: 2.1 time: 0.439158 May 13 13:30:54.059882 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 470/916] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:53 2022] GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19 => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:54.979829 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-98882a9c-8395-415f-b00d-81e5a4ec7426 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:54.983172 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-98882a9c-8395-415f-b00d-81e5a4ec7426 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:54.997516 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-98882a9c-8395-415f-b00d-81e5a4ec7426 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:54.998037 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-98882a9c-8395-415f-b00d-81e5a4ec7426 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:54.999360 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-98882a9c-8395-415f-b00d-81e5a4ec7426 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:55.000074 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-98882a9c-8395-415f-b00d-81e5a4ec7426 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:55.080915 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-97c2c049-0834-4694-acba-fee1a245d465 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:55.083401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-97c2c049-0834-4694-acba-fee1a245d465 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] [instance: b4daf8d5-ea57-459f-b1fb-e6de316e6f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:55.106117 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-97c2c049-0834-4694-acba-fee1a245d465 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:55.115114 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-97c2c049-0834-4694-acba-fee1a245d465 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:55.116257 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-97c2c049-0834-4694-acba-fee1a245d465 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:55.116874 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-97c2c049-0834-4694-acba-fee1a245d465 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:55.293572 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-98882a9c-8395-415f-b00d-81e5a4ec7426 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:55.306055 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-98882a9c-8395-415f-b00d-81e5a4ec7426 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1576 microversion: 2.1 time: 0.335008 May 13 13:30:55.307418 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 447/917] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:54 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1576 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:55.627754 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-97c2c049-0834-4694-acba-fee1a245d465 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2295ff56baa424792e45ed742fe1bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bb17eb306045cb83c0a1b8e69b500d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:55.635347 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-97c2c049-0834-4694-acba-fee1a245d465 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] 10.222.0.13 "GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19" status: 200 len: 1315 microversion: 2.1 time: 0.562148 May 13 13:30:55.636280 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 471/918] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:55 2022] GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19 => generated 1315 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:56.324742 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-003253d8-2ddf-4c39-859b-3d8fc0c6be9a tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:56.325447 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-003253d8-2ddf-4c39-859b-3d8fc0c6be9a tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:56.334832 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-003253d8-2ddf-4c39-859b-3d8fc0c6be9a tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:56.335336 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-003253d8-2ddf-4c39-859b-3d8fc0c6be9a tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:56.336577 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-003253d8-2ddf-4c39-859b-3d8fc0c6be9a tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:56.337591 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-003253d8-2ddf-4c39-859b-3d8fc0c6be9a tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:56.590159 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-003253d8-2ddf-4c39-859b-3d8fc0c6be9a tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:56.601587 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-003253d8-2ddf-4c39-859b-3d8fc0c6be9a tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1576 microversion: 2.1 time: 0.281990 May 13 13:30:56.602181 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 448/919] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:56 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1576 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:56.655689 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e199925b-1fd3-4929-9863-0ee184f8c204 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:56.656351 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e199925b-1fd3-4929-9863-0ee184f8c204 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] [instance: b4daf8d5-ea57-459f-b1fb-e6de316e6f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:56.663911 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e199925b-1fd3-4929-9863-0ee184f8c204 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:56.664996 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e199925b-1fd3-4929-9863-0ee184f8c204 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:56.666000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e199925b-1fd3-4929-9863-0ee184f8c204 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:56.666663 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e199925b-1fd3-4929-9863-0ee184f8c204 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:56.973940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e199925b-1fd3-4929-9863-0ee184f8c204 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2295ff56baa424792e45ed742fe1bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bb17eb306045cb83c0a1b8e69b500d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:56.985043 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e199925b-1fd3-4929-9863-0ee184f8c204 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] 10.222.0.13 "GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19" status: 200 len: 1315 microversion: 2.1 time: 0.336235 May 13 13:30:56.988549 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 472/920] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:56 2022] GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19 => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:57.620637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-94fd5771-81f5-42c7-a878-befc6e68d06b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:57.622833 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-94fd5771-81f5-42c7-a878-befc6e68d06b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:57.630045 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-94fd5771-81f5-42c7-a878-befc6e68d06b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:57.630913 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-94fd5771-81f5-42c7-a878-befc6e68d06b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:57.632259 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-94fd5771-81f5-42c7-a878-befc6e68d06b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:57.632864 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-94fd5771-81f5-42c7-a878-befc6e68d06b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:57.837262 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-94fd5771-81f5-42c7-a878-befc6e68d06b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:57.851301 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-94fd5771-81f5-42c7-a878-befc6e68d06b tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1563 microversion: 2.1 time: 0.235920 May 13 13:30:57.853242 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 449/921] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:57 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1563 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:58.007862 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3ef7af6b-edd0-4578-9b7d-9b72d589af13 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:58.007862 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3ef7af6b-edd0-4578-9b7d-9b72d589af13 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] [instance: b4daf8d5-ea57-459f-b1fb-e6de316e6f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:58.021021 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3ef7af6b-edd0-4578-9b7d-9b72d589af13 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:58.021485 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3ef7af6b-edd0-4578-9b7d-9b72d589af13 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:58.022356 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3ef7af6b-edd0-4578-9b7d-9b72d589af13 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:58.023038 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3ef7af6b-edd0-4578-9b7d-9b72d589af13 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:58.226425 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3ef7af6b-edd0-4578-9b7d-9b72d589af13 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2295ff56baa424792e45ed742fe1bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bb17eb306045cb83c0a1b8e69b500d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:58.241291 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3ef7af6b-edd0-4578-9b7d-9b72d589af13 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] 10.222.0.13 "GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19" status: 200 len: 1315 microversion: 2.1 time: 0.242605 May 13 13:30:58.252385 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 473/922] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:57 2022] GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:59.265898 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1c675f2f-3ace-4d23-89a9-e50f14916874 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:59.267027 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1c675f2f-3ace-4d23-89a9-e50f14916874 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] [instance: b4daf8d5-ea57-459f-b1fb-e6de316e6f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:59.295716 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1c675f2f-3ace-4d23-89a9-e50f14916874 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:59.296336 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1c675f2f-3ace-4d23-89a9-e50f14916874 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:59.297974 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1c675f2f-3ace-4d23-89a9-e50f14916874 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:59.299030 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1c675f2f-3ace-4d23-89a9-e50f14916874 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:59.535313 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1c675f2f-3ace-4d23-89a9-e50f14916874 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2295ff56baa424792e45ed742fe1bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bb17eb306045cb83c0a1b8e69b500d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:59.542912 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1c675f2f-3ace-4d23-89a9-e50f14916874 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] 10.222.0.13 "GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19" status: 200 len: 1315 microversion: 2.1 time: 0.286745 May 13 13:30:59.543491 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 450/923] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:30:59 2022] GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:31:00.560470 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-07b38e16-f69e-4a9c-91b4-5e44f11f80c2 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:00.561688 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-07b38e16-f69e-4a9c-91b4-5e44f11f80c2 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] [instance: b4daf8d5-ea57-459f-b1fb-e6de316e6f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:00.568427 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-07b38e16-f69e-4a9c-91b4-5e44f11f80c2 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:00.568872 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-07b38e16-f69e-4a9c-91b4-5e44f11f80c2 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:00.569834 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-07b38e16-f69e-4a9c-91b4-5e44f11f80c2 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:00.570290 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-07b38e16-f69e-4a9c-91b4-5e44f11f80c2 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:00.708202 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-07b38e16-f69e-4a9c-91b4-5e44f11f80c2 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2295ff56baa424792e45ed742fe1bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bb17eb306045cb83c0a1b8e69b500d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:00.715472 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-07b38e16-f69e-4a9c-91b4-5e44f11f80c2 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] 10.222.0.13 "GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19" status: 200 len: 1315 microversion: 2.1 time: 0.159015 May 13 13:31:00.716534 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 474/924] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:00 2022] GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:00.857419 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-f55ac797-6788-433f-b8b0-2de906157b5e req-6cdb8b9c-0293-46c1-a3c2-0ca0c2c901be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4daf8d5-ea57-459f-b1fb-e6de316e6f19", "name": "network-vif-plugged", "status": "completed", "tag": "25145e1a-a6a1-42c7-b0d0-4e1fe4ae001b"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:00.867432 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-f55ac797-6788-433f-b8b0-2de906157b5e req-6cdb8b9c-0293-46c1-a3c2-0ca0c2c901be service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:00.867885 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-f55ac797-6788-433f-b8b0-2de906157b5e req-6cdb8b9c-0293-46c1-a3c2-0ca0c2c901be service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:00.879118 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-f55ac797-6788-433f-b8b0-2de906157b5e req-6cdb8b9c-0293-46c1-a3c2-0ca0c2c901be service nova] Creating event network-vif-plugged:25145e1a-a6a1-42c7-b0d0-4e1fe4ae001b for instance b4daf8d5-ea57-459f-b1fb-e6de316e6f19 on hv-cinder-84163 May 13 13:31:00.884241 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-f55ac797-6788-433f-b8b0-2de906157b5e req-6cdb8b9c-0293-46c1-a3c2-0ca0c2c901be service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031183 May 13 13:31:00.884840 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 451/925] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:31:01.733860 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-99f6d0b0-ecfd-4e36-b542-3e007d62bdd4 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:01.736145 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-99f6d0b0-ecfd-4e36-b542-3e007d62bdd4 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] [instance: b4daf8d5-ea57-459f-b1fb-e6de316e6f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:01.742225 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-99f6d0b0-ecfd-4e36-b542-3e007d62bdd4 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:01.742929 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-99f6d0b0-ecfd-4e36-b542-3e007d62bdd4 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:01.743722 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-99f6d0b0-ecfd-4e36-b542-3e007d62bdd4 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:01.744150 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-99f6d0b0-ecfd-4e36-b542-3e007d62bdd4 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:01.918734 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-99f6d0b0-ecfd-4e36-b542-3e007d62bdd4 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2295ff56baa424792e45ed742fe1bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bb17eb306045cb83c0a1b8e69b500d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:01.929199 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-99f6d0b0-ecfd-4e36-b542-3e007d62bdd4 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] 10.222.0.13 "GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19" status: 200 len: 1315 microversion: 2.1 time: 0.200162 May 13 13:31:01.946295 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 475/926] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:01 2022] GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:02.982997 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-cc3524d0-1005-4d3e-8037-830acdf5604c tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:02.983839 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-cc3524d0-1005-4d3e-8037-830acdf5604c tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] [instance: b4daf8d5-ea57-459f-b1fb-e6de316e6f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:02.992652 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cc3524d0-1005-4d3e-8037-830acdf5604c tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:02.993449 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cc3524d0-1005-4d3e-8037-830acdf5604c tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:02.994537 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cc3524d0-1005-4d3e-8037-830acdf5604c tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:02.995237 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cc3524d0-1005-4d3e-8037-830acdf5604c tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:03.209863 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-cc3524d0-1005-4d3e-8037-830acdf5604c tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2295ff56baa424792e45ed742fe1bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bb17eb306045cb83c0a1b8e69b500d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:03.222466 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-cc3524d0-1005-4d3e-8037-830acdf5604c tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] 10.222.0.13 "GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19" status: 200 len: 1315 microversion: 2.1 time: 0.269317 May 13 13:31:03.223892 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 452/927] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:02 2022] GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:31:04.241194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0140a99b-44b9-486f-9e32-898cda2937fe tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:04.241800 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0140a99b-44b9-486f-9e32-898cda2937fe tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] [instance: b4daf8d5-ea57-459f-b1fb-e6de316e6f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:04.249716 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0140a99b-44b9-486f-9e32-898cda2937fe tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:04.250167 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0140a99b-44b9-486f-9e32-898cda2937fe tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:04.251040 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0140a99b-44b9-486f-9e32-898cda2937fe tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:04.251472 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0140a99b-44b9-486f-9e32-898cda2937fe tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:04.394937 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0140a99b-44b9-486f-9e32-898cda2937fe tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2295ff56baa424792e45ed742fe1bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bb17eb306045cb83c0a1b8e69b500d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:04.403033 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0140a99b-44b9-486f-9e32-898cda2937fe tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] 10.222.0.13 "GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19" status: 200 len: 1464 microversion: 2.1 time: 0.166000 May 13 13:31:04.403861 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 476/928] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:04 2022] GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19 => generated 1464 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:04.445461 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b3b8dac0-748c-4546-a696-0e9f13b12dcc tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:04.446033 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b3b8dac0-748c-4546-a696-0e9f13b12dcc tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] [instance: b4daf8d5-ea57-459f-b1fb-e6de316e6f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:04.452575 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b3b8dac0-748c-4546-a696-0e9f13b12dcc tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:04.453027 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b3b8dac0-748c-4546-a696-0e9f13b12dcc tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:04.453800 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b3b8dac0-748c-4546-a696-0e9f13b12dcc tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:04.454252 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b3b8dac0-748c-4546-a696-0e9f13b12dcc tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:04.483166 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b3b8dac0-748c-4546-a696-0e9f13b12dcc tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] [instance: b4daf8d5-ea57-459f-b1fb-e6de316e6f19] Going to try to terminate instance {{(pid=117720) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:31:04.844787 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b3b8dac0-748c-4546-a696-0e9f13b12dcc tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19" status: 204 len: 0 microversion: 2.1 time: 0.402746 May 13 13:31:04.848105 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 453/929] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:31:04 2022] DELETE /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:31:04.857880 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ab8c550b-8fc7-4f86-9361-0263c7fe3499 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:04.858720 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ab8c550b-8fc7-4f86-9361-0263c7fe3499 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] [instance: b4daf8d5-ea57-459f-b1fb-e6de316e6f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:04.864999 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ab8c550b-8fc7-4f86-9361-0263c7fe3499 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:04.865849 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ab8c550b-8fc7-4f86-9361-0263c7fe3499 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:04.866863 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ab8c550b-8fc7-4f86-9361-0263c7fe3499 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:04.867459 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ab8c550b-8fc7-4f86-9361-0263c7fe3499 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:05.040114 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ab8c550b-8fc7-4f86-9361-0263c7fe3499 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2295ff56baa424792e45ed742fe1bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bb17eb306045cb83c0a1b8e69b500d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:05.048308 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ab8c550b-8fc7-4f86-9361-0263c7fe3499 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] 10.222.0.13 "GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19" status: 200 len: 1470 microversion: 2.1 time: 0.195795 May 13 13:31:05.049498 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 477/930] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:04 2022] GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19 => generated 1470 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:31:06.066960 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-fea693f3-9164-4415-bdb2-79661448ef9c tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:06.067670 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-fea693f3-9164-4415-bdb2-79661448ef9c tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] [instance: b4daf8d5-ea57-459f-b1fb-e6de316e6f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:06.074646 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fea693f3-9164-4415-bdb2-79661448ef9c tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:06.075154 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fea693f3-9164-4415-bdb2-79661448ef9c tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:06.075951 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fea693f3-9164-4415-bdb2-79661448ef9c tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:06.076652 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fea693f3-9164-4415-bdb2-79661448ef9c tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:06.236902 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fea693f3-9164-4415-bdb2-79661448ef9c tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2295ff56baa424792e45ed742fe1bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bb17eb306045cb83c0a1b8e69b500d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:06.245231 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-fea693f3-9164-4415-bdb2-79661448ef9c tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] 10.222.0.13 "GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19" status: 200 len: 1470 microversion: 2.1 time: 0.183590 May 13 13:31:06.246387 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 454/931] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:06 2022] GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19 => generated 1470 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:07.263230 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-38ce58b0-9699-488c-9981-3f3ec3ae77f5 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:07.263857 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-38ce58b0-9699-488c-9981-3f3ec3ae77f5 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] [instance: b4daf8d5-ea57-459f-b1fb-e6de316e6f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:07.270496 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-38ce58b0-9699-488c-9981-3f3ec3ae77f5 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:07.270919 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-38ce58b0-9699-488c-9981-3f3ec3ae77f5 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:07.271719 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-38ce58b0-9699-488c-9981-3f3ec3ae77f5 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:07.272164 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-38ce58b0-9699-488c-9981-3f3ec3ae77f5 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:07.422278 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-38ce58b0-9699-488c-9981-3f3ec3ae77f5 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2295ff56baa424792e45ed742fe1bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bb17eb306045cb83c0a1b8e69b500d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:07.432155 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-38ce58b0-9699-488c-9981-3f3ec3ae77f5 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] 10.222.0.13 "GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19" status: 200 len: 1470 microversion: 2.1 time: 0.173364 May 13 13:31:07.433042 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 478/932] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:07 2022] GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19 => generated 1470 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:08.139450 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ac0e3c83-2efb-420d-a03c-583083e5c2d6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Action: 'create', calling method: .version_select at 0x7fb0840c8940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-363617485", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnkcmA+B/VwmCUAWHNp8w/AyZDefdNWnpQ9xf1OfpFrzTLDJWZWKx/Dnd78FNrvXy6VzGDWVSZcfkRV8V66XOwW0fBhm8ADRwvbMh8jum9bHZR1ls5QkhD46A/9KK1RgA=="}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:08.154972 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-ac0e3c83-2efb-420d-a03c-583083e5c2d6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Getting quotas for project a3d1e5b7a3054d769e38bb8e12b202af. Resources: {'key_pairs'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:31:08.159628 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-ac0e3c83-2efb-420d-a03c-583083e5c2d6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Getting quotas for user 51b8bece6df0455b8e3e5ffbc24c498b and project a3d1e5b7a3054d769e38bb8e12b202af. Resources: {'key_pairs'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:31:08.244905 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ac0e3c83-2efb-420d-a03c-583083e5c2d6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.110186 May 13 13:31:08.245559 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 455/933] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 13 13:31:08 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:31:08.341264 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-9c880e03-ce6c-4e54-9ce1-6723a2d26031 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1082908774", "imageRef": "264ac6af-a8c6-4176-8a18-4dda619a1324", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-363617485", "networks": [{"uuid": "da658553-b4a3-4d8d-bf86-544abb5d20b7"}]}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:08.394071 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.network.neutron [None req-9c880e03-ce6c-4e54-9ce1-6723a2d26031 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] validate_networks() for [('da658553-b4a3-4d8d-bf86-544abb5d20b7', None, None, None, None, None)] {{(pid=117721) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:31:08.451624 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d8e3f7a8-a861-4071-934a-54920121b204 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:08.452283 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d8e3f7a8-a861-4071-934a-54920121b204 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] [instance: b4daf8d5-ea57-459f-b1fb-e6de316e6f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:08.458174 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d8e3f7a8-a861-4071-934a-54920121b204 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:08.458652 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d8e3f7a8-a861-4071-934a-54920121b204 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:08.459426 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d8e3f7a8-a861-4071-934a-54920121b204 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:08.459857 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d8e3f7a8-a861-4071-934a-54920121b204 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:08.645636 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d8e3f7a8-a861-4071-934a-54920121b204 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2295ff56baa424792e45ed742fe1bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bb17eb306045cb83c0a1b8e69b500d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:08.652960 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d8e3f7a8-a861-4071-934a-54920121b204 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] 10.222.0.13 "GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19" status: 200 len: 1470 microversion: 2.1 time: 0.206473 May 13 13:31:08.654258 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 456/934] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:08 2022] GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19 => generated 1470 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:31:08.898336 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-9c880e03-ce6c-4e54-9ce1-6723a2d26031 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Flavor limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:31:08.898735 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-9c880e03-ce6c-4e54-9ce1-6723a2d26031 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Image limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:31:08.899201 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-9c880e03-ce6c-4e54-9ce1-6723a2d26031 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Flavor pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:31:08.899603 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-9c880e03-ce6c-4e54-9ce1-6723a2d26031 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Image pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:31:08.900009 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-9c880e03-ce6c-4e54-9ce1-6723a2d26031 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:31:08.909215 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9c880e03-ce6c-4e54-9ce1-6723a2d26031 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:08.909669 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9c880e03-ce6c-4e54-9ce1-6723a2d26031 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:08.911157 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9c880e03-ce6c-4e54-9ce1-6723a2d26031 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:08.911587 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9c880e03-ce6c-4e54-9ce1-6723a2d26031 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:08.928692 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-9c880e03-ce6c-4e54-9ce1-6723a2d26031 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Getting quotas for project a3d1e5b7a3054d769e38bb8e12b202af. Resources: {'cores', 'instances', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:31:08.932614 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-9c880e03-ce6c-4e54-9ce1-6723a2d26031 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Getting quotas for user 51b8bece6df0455b8e3e5ffbc24c498b and project a3d1e5b7a3054d769e38bb8e12b202af. Resources: {'cores', 'instances', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:31:08.944262 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-9c880e03-ce6c-4e54-9ce1-6723a2d26031 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Going to run 1 instances... {{(pid=117721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:31:08.946627 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-9c880e03-ce6c-4e54-9ce1-6723a2d26031 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='264ac6af-a8c6-4176-8a18-4dda619a1324',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:31:09.097374 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-9c880e03-ce6c-4e54-9ce1-6723a2d26031 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.760170 May 13 13:31:09.098029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 479/935] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 13 13:31:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:31:09.109162 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c2c58329-d54d-42d7-acca-433157fe7494 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:09.109769 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c2c58329-d54d-42d7-acca-433157fe7494 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:09.171606 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c2c58329-d54d-42d7-acca-433157fe7494 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:09.180422 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c2c58329-d54d-42d7-acca-433157fe7494 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1258 microversion: 2.1 time: 0.076282 May 13 13:31:09.181152 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 457/936] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:09 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1258 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:09.671535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-13ff8344-072b-4851-a044-20b33d3c3002 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:09.672086 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-13ff8344-072b-4851-a044-20b33d3c3002 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] [instance: b4daf8d5-ea57-459f-b1fb-e6de316e6f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:09.678161 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-13ff8344-072b-4851-a044-20b33d3c3002 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:09.678647 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-13ff8344-072b-4851-a044-20b33d3c3002 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:09.679431 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-13ff8344-072b-4851-a044-20b33d3c3002 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:09.679873 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-13ff8344-072b-4851-a044-20b33d3c3002 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:09.841587 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-13ff8344-072b-4851-a044-20b33d3c3002 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2295ff56baa424792e45ed742fe1bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bb17eb306045cb83c0a1b8e69b500d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:09.851726 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-13ff8344-072b-4851-a044-20b33d3c3002 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] 10.222.0.13 "GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19" status: 200 len: 1470 microversion: 2.1 time: 0.185054 May 13 13:31:09.852320 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 480/937] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:09 2022] GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19 => generated 1470 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:10.202765 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-dcec9045-0228-43d9-aa11-d81176814b4d tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:10.203684 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-dcec9045-0228-43d9-aa11-d81176814b4d tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:10.260311 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dcec9045-0228-43d9-aa11-d81176814b4d tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:10.267321 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-dcec9045-0228-43d9-aa11-d81176814b4d tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1258 microversion: 2.1 time: 0.071214 May 13 13:31:10.267977 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 458/938] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:10 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:10.410478 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-f23591a9-654d-4648-a600-9d9f6fea2a54 req-0d0d4ddd-9276-4633-a03f-7894acb3fcfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4daf8d5-ea57-459f-b1fb-e6de316e6f19", "name": "network-vif-deleted", "tag": "25145e1a-a6a1-42c7-b0d0-4e1fe4ae001b"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:10.420141 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-f23591a9-654d-4648-a600-9d9f6fea2a54 req-0d0d4ddd-9276-4633-a03f-7894acb3fcfc service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:10.420506 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-f23591a9-654d-4648-a600-9d9f6fea2a54 req-0d0d4ddd-9276-4633-a03f-7894acb3fcfc service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:10.436364 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-f23591a9-654d-4648-a600-9d9f6fea2a54 req-0d0d4ddd-9276-4633-a03f-7894acb3fcfc service nova] Creating event network-vif-deleted:25145e1a-a6a1-42c7-b0d0-4e1fe4ae001b for instance b4daf8d5-ea57-459f-b1fb-e6de316e6f19 on hv-cinder-84163 May 13 13:31:10.442489 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-f23591a9-654d-4648-a600-9d9f6fea2a54 req-0d0d4ddd-9276-4633-a03f-7894acb3fcfc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036203 May 13 13:31:10.448753 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 481/939] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:31:10.869137 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-835b8354-5d30-4262-a7b1-e08168aa0004 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:10.869756 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-835b8354-5d30-4262-a7b1-e08168aa0004 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] [instance: b4daf8d5-ea57-459f-b1fb-e6de316e6f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:10.876605 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-835b8354-5d30-4262-a7b1-e08168aa0004 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:10.877060 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-835b8354-5d30-4262-a7b1-e08168aa0004 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:10.877842 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-835b8354-5d30-4262-a7b1-e08168aa0004 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:10.878317 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-835b8354-5d30-4262-a7b1-e08168aa0004 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:10.915219 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-835b8354-5d30-4262-a7b1-e08168aa0004 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:10.915747 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-835b8354-5d30-4262-a7b1-e08168aa0004 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:10.916215 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-835b8354-5d30-4262-a7b1-e08168aa0004 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lazy-loading 'fault' on Instance uuid b4daf8d5-ea57-459f-b1fb-e6de316e6f19 {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:31:10.960399 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-835b8354-5d30-4262-a7b1-e08168aa0004 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2295ff56baa424792e45ed742fe1bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bb17eb306045cb83c0a1b8e69b500d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:10.978529 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-835b8354-5d30-4262-a7b1-e08168aa0004 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] 10.222.0.13 "GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19" status: 200 len: 1305 microversion: 2.1 time: 0.103851 May 13 13:31:10.978529 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 459/940] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:10 2022] GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19 => generated 1305 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:31:11.286128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1c684f61-9c49-4f89-bc27-0c5d0cfc82fd tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:11.286836 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1c684f61-9c49-4f89-bc27-0c5d0cfc82fd tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:11.293538 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1c684f61-9c49-4f89-bc27-0c5d0cfc82fd tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:11.294613 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1c684f61-9c49-4f89-bc27-0c5d0cfc82fd tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:11.295320 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1c684f61-9c49-4f89-bc27-0c5d0cfc82fd tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:11.295749 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1c684f61-9c49-4f89-bc27-0c5d0cfc82fd tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:11.358116 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1c684f61-9c49-4f89-bc27-0c5d0cfc82fd tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:11.365511 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1c684f61-9c49-4f89-bc27-0c5d0cfc82fd tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1254 microversion: 2.1 time: 0.084066 May 13 13:31:11.366079 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 482/941] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:11 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1254 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:11.993132 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-deccd340-7c8f-48a5-9c2e-ace743b39a5a tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:11.993685 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-deccd340-7c8f-48a5-9c2e-ace743b39a5a tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] [instance: b4daf8d5-ea57-459f-b1fb-e6de316e6f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:12.000737 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-deccd340-7c8f-48a5-9c2e-ace743b39a5a tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:12.001189 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-deccd340-7c8f-48a5-9c2e-ace743b39a5a tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:12.002021 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-deccd340-7c8f-48a5-9c2e-ace743b39a5a tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:12.002522 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-deccd340-7c8f-48a5-9c2e-ace743b39a5a tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:12.035885 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-deccd340-7c8f-48a5-9c2e-ace743b39a5a tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:12.036336 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-deccd340-7c8f-48a5-9c2e-ace743b39a5a tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:12.036809 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-deccd340-7c8f-48a5-9c2e-ace743b39a5a tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lazy-loading 'fault' on Instance uuid b4daf8d5-ea57-459f-b1fb-e6de316e6f19 {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:31:12.082538 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-deccd340-7c8f-48a5-9c2e-ace743b39a5a tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2295ff56baa424792e45ed742fe1bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bb17eb306045cb83c0a1b8e69b500d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:12.090000 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-deccd340-7c8f-48a5-9c2e-ace743b39a5a tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] 10.222.0.13 "GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19" status: 200 len: 1305 microversion: 2.1 time: 0.100908 May 13 13:31:12.090640 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 460/942] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:11 2022] GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19 => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:12.386666 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c7f541cf-af2f-4878-a4f1-a1a64e3543fe tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:12.387269 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c7f541cf-af2f-4878-a4f1-a1a64e3543fe tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:12.394031 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c7f541cf-af2f-4878-a4f1-a1a64e3543fe tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:12.394503 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c7f541cf-af2f-4878-a4f1-a1a64e3543fe tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:12.395270 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c7f541cf-af2f-4878-a4f1-a1a64e3543fe tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:12.395705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c7f541cf-af2f-4878-a4f1-a1a64e3543fe tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:12.456751 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c7f541cf-af2f-4878-a4f1-a1a64e3543fe tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:12.464411 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c7f541cf-af2f-4878-a4f1-a1a64e3543fe tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1254 microversion: 2.1 time: 0.081570 May 13 13:31:12.465130 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 483/943] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:12 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1254 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:13.108040 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ae64fbf3-c8d8-4fa5-be19-e7b5e69242c8 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:13.108665 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ae64fbf3-c8d8-4fa5-be19-e7b5e69242c8 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] [instance: b4daf8d5-ea57-459f-b1fb-e6de316e6f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:13.115027 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ae64fbf3-c8d8-4fa5-be19-e7b5e69242c8 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:13.115476 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ae64fbf3-c8d8-4fa5-be19-e7b5e69242c8 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:13.116246 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ae64fbf3-c8d8-4fa5-be19-e7b5e69242c8 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:13.116682 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ae64fbf3-c8d8-4fa5-be19-e7b5e69242c8 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:13.148261 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ae64fbf3-c8d8-4fa5-be19-e7b5e69242c8 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:13.148712 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ae64fbf3-c8d8-4fa5-be19-e7b5e69242c8 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:13.149173 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-ae64fbf3-c8d8-4fa5-be19-e7b5e69242c8 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lazy-loading 'fault' on Instance uuid b4daf8d5-ea57-459f-b1fb-e6de316e6f19 {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:31:13.191730 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ae64fbf3-c8d8-4fa5-be19-e7b5e69242c8 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2295ff56baa424792e45ed742fe1bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bb17eb306045cb83c0a1b8e69b500d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:13.199279 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ae64fbf3-c8d8-4fa5-be19-e7b5e69242c8 tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] 10.222.0.13 "GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19" status: 200 len: 1305 microversion: 2.1 time: 0.095815 May 13 13:31:13.200064 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 461/944] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:13 2022] GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19 => generated 1305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:13.481141 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-825f0d6d-75c1-48c0-aa33-ae529460f4b7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:13.482098 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-825f0d6d-75c1-48c0-aa33-ae529460f4b7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:13.488574 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-825f0d6d-75c1-48c0-aa33-ae529460f4b7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:13.489237 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-825f0d6d-75c1-48c0-aa33-ae529460f4b7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:13.489941 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-825f0d6d-75c1-48c0-aa33-ae529460f4b7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:13.490403 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-825f0d6d-75c1-48c0-aa33-ae529460f4b7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:13.552703 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-825f0d6d-75c1-48c0-aa33-ae529460f4b7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:13.560561 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-825f0d6d-75c1-48c0-aa33-ae529460f4b7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1254 microversion: 2.1 time: 0.083444 May 13 13:31:13.561123 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 484/945] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:13 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1254 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:14.217969 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e2e76927-5674-4308-8f52-ee6b55a7e34e tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:14.218763 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e2e76927-5674-4308-8f52-ee6b55a7e34e tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] [instance: b4daf8d5-ea57-459f-b1fb-e6de316e6f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:14.225444 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e2e76927-5674-4308-8f52-ee6b55a7e34e tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:14.225888 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e2e76927-5674-4308-8f52-ee6b55a7e34e tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:14.226671 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e2e76927-5674-4308-8f52-ee6b55a7e34e tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:14.227102 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e2e76927-5674-4308-8f52-ee6b55a7e34e tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:14.241057 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-e2e76927-5674-4308-8f52-ee6b55a7e34e tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] HTTP exception thrown: Instance b4daf8d5-ea57-459f-b1fb-e6de316e6f19 could not be found. May 13 13:31:14.242744 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e2e76927-5674-4308-8f52-ee6b55a7e34e tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Request method failure captured: May 13 13:31:14.242744 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19 HTTP/1.1 May 13 13:31:14.242744 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept: application/json May 13 13:31:14.242744 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity May 13 13:31:14.242744 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Connection: close May 13 13:31:14.242744 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Length: 0 May 13 13:31:14.242744 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Type: application/json May 13 13:31:14.242744 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Host: 10.222.0.13 May 13 13:31:14.242744 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None May 13 13:31:14.242744 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 May 13 13:31:14.242744 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABifl2CGoMcU_0uUMEooyX4F9daHjq3fBDlrTp8qrJRE1VXZqkYfXYMPShttKzZerZDITyo91DRP4lvGPKnCG3hgiYnem4glpFySytro5au4oXoQmunhbzNeTFmggUAiNxh44B-WODoDcUduqlKsB4M2IPq5zs2Y7Qf-TNUEsddWnuozr8 May 13 13:31:14.242744 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Id: None May 13 13:31:14.242744 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Name: None May 13 13:31:14.242744 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed May 13 13:31:14.242744 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True May 13 13:31:14.242744 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default May 13 13:31:14.242744 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default May 13 13:31:14.242744 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Id: 34bb17eb306045cb83c0a1b8e69b500d May 13 13:31:14.242744 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-VolumesNegativeTest-2022173465 May 13 13:31:14.242744 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Role: member,reader May 13 13:31:14.242744 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Roles: member,reader May 13 13:31:14.244455 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_34bb17eb306045cb83c0a1b8e69b500d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/34bb17eb306045cb83c0a1b8e69b500d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/34bb17eb306045cb83c0a1b8e69b500d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/34bb17eb306045cb83c0a1b8e69b500d"}]}] May 13 13:31:14.244455 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-VolumesNegativeTest-2022173465 May 13 13:31:14.244455 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 34bb17eb306045cb83c0a1b8e69b500d May 13 13:31:14.244455 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-VolumesNegativeTest-2022173465 May 13 13:31:14.244455 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User: tempest-VolumesNegativeTest-2022173465-project May 13 13:31:14.244455 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default May 13 13:31:14.244455 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default May 13 13:31:14.244455 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Id: d2295ff56baa424792e45ed742fe1bad May 13 13:31:14.244455 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-VolumesNegativeTest-2022173465-project May 13 13:31:14.244455 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: method: > May 13 13:31:14.244455 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: exception: Instance b4daf8d5-ea57-459f-b1fb-e6de316e6f19 could not be found. May 13 13:31:14.244455 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: action_args: {'id': 'b4daf8d5-ea57-459f-b1fb-e6de316e6f19'} May 13 13:31:14.245424 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:31:14.245424 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:31:14.245424 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:31:14.245424 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:31:14.245424 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:31:14.245424 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:31:14.245424 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:31:14.245424 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:31:14.245424 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:31:14.245424 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:31:14.245424 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4daf8d5-ea57-459f-b1fb-e6de316e6f19 could not be found. May 13 13:31:14.245424 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:31:14.245424 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:31:14.245424 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:31:14.245424 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:31:14.245424 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:31:14.245424 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:31:14.245424 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:31:14.245424 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:31:14.245424 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:31:14.247082 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:31:14.247082 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:31:14.247082 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:31:14.247082 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:31:14.247082 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:31:14.247082 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:31:14.247082 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:31:14.247082 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4daf8d5-ea57-459f-b1fb-e6de316e6f19 could not be found. May 13 13:31:14.247082 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:31:14.247082 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:31:14.247082 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:31:14.247082 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:31:14.247082 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:31:14.247082 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:31:14.247082 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:31:14.247082 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:31:14.247082 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4daf8d5-ea57-459f-b1fb-e6de316e6f19 could not be found. May 13 13:31:14.247082 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:31:14.248459 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e2e76927-5674-4308-8f52-ee6b55a7e34e tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] Returning 404 to user: Instance b4daf8d5-ea57-459f-b1fb-e6de316e6f19 could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:31:14.248459 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e2e76927-5674-4308-8f52-ee6b55a7e34e tempest-VolumesNegativeTest-2022173465 tempest-VolumesNegativeTest-2022173465-project] 10.222.0.13 "GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19" status: 404 len: 111 microversion: 2.1 time: 0.031139 May 13 13:31:14.248459 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 462/946] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:14 2022] GET /compute/v2.1/servers/b4daf8d5-ea57-459f-b1fb-e6de316e6f19 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:31:14.579296 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4c7ad3f5-4a25-4e0d-9eed-88bc8fd80ec7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:14.580772 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4c7ad3f5-4a25-4e0d-9eed-88bc8fd80ec7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:14.587402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4c7ad3f5-4a25-4e0d-9eed-88bc8fd80ec7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:14.588171 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4c7ad3f5-4a25-4e0d-9eed-88bc8fd80ec7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:14.589151 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4c7ad3f5-4a25-4e0d-9eed-88bc8fd80ec7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:14.589596 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4c7ad3f5-4a25-4e0d-9eed-88bc8fd80ec7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:14.661769 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4c7ad3f5-4a25-4e0d-9eed-88bc8fd80ec7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:14.669398 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4c7ad3f5-4a25-4e0d-9eed-88bc8fd80ec7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1310 microversion: 2.1 time: 0.096015 May 13 13:31:14.669967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 485/947] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:14 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1310 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:15.701950 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-877a47ae-f50b-400d-954f-177b9884a937 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:15.706102 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-877a47ae-f50b-400d-954f-177b9884a937 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:15.718425 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-877a47ae-f50b-400d-954f-177b9884a937 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:15.719965 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-877a47ae-f50b-400d-954f-177b9884a937 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:15.721468 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-877a47ae-f50b-400d-954f-177b9884a937 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:15.723110 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-877a47ae-f50b-400d-954f-177b9884a937 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:15.979988 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-877a47ae-f50b-400d-954f-177b9884a937 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:15.991465 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-877a47ae-f50b-400d-954f-177b9884a937 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1358 microversion: 2.1 time: 0.304101 May 13 13:31:15.992425 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 463/948] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:15 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1358 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:17.011638 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-27163bc9-3365-459c-a846-1f073b8ef4d3 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:17.012300 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-27163bc9-3365-459c-a846-1f073b8ef4d3 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:17.029672 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-27163bc9-3365-459c-a846-1f073b8ef4d3 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:17.031191 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-27163bc9-3365-459c-a846-1f073b8ef4d3 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:17.034981 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-27163bc9-3365-459c-a846-1f073b8ef4d3 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:17.035548 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-27163bc9-3365-459c-a846-1f073b8ef4d3 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:17.217339 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-27163bc9-3365-459c-a846-1f073b8ef4d3 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:17.226076 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-27163bc9-3365-459c-a846-1f073b8ef4d3 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1358 microversion: 2.1 time: 0.219517 May 13 13:31:17.227063 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 486/949] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:17 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:18.244422 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-af67afbe-18f7-4609-8e31-e1cc29686769 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:18.245948 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-af67afbe-18f7-4609-8e31-e1cc29686769 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:18.253543 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-af67afbe-18f7-4609-8e31-e1cc29686769 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:18.254002 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-af67afbe-18f7-4609-8e31-e1cc29686769 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:18.254968 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-af67afbe-18f7-4609-8e31-e1cc29686769 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:18.255573 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-af67afbe-18f7-4609-8e31-e1cc29686769 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:18.476773 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-af67afbe-18f7-4609-8e31-e1cc29686769 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:18.485185 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-af67afbe-18f7-4609-8e31-e1cc29686769 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1358 microversion: 2.1 time: 0.244954 May 13 13:31:18.485783 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 464/950] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:18 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:31:19.505341 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-94d9503d-2e12-4990-97f9-1dcc670a8286 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:19.506897 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-94d9503d-2e12-4990-97f9-1dcc670a8286 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:19.514067 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-94d9503d-2e12-4990-97f9-1dcc670a8286 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:19.514769 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-94d9503d-2e12-4990-97f9-1dcc670a8286 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:19.515736 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-94d9503d-2e12-4990-97f9-1dcc670a8286 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:19.516685 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-94d9503d-2e12-4990-97f9-1dcc670a8286 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:19.748449 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-94d9503d-2e12-4990-97f9-1dcc670a8286 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:19.771124 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-94d9503d-2e12-4990-97f9-1dcc670a8286 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1358 microversion: 2.1 time: 0.270245 May 13 13:31:19.786318 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 487/951] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:19 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1358 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:20.791690 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-76c229bf-87d9-4749-af84-6460f38150fb tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:20.792294 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-76c229bf-87d9-4749-af84-6460f38150fb tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:20.799290 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-76c229bf-87d9-4749-af84-6460f38150fb tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:20.799729 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-76c229bf-87d9-4749-af84-6460f38150fb tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:20.807699 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-76c229bf-87d9-4749-af84-6460f38150fb tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:20.807699 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-76c229bf-87d9-4749-af84-6460f38150fb tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:20.938653 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-76c229bf-87d9-4749-af84-6460f38150fb tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:20.944929 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-76c229bf-87d9-4749-af84-6460f38150fb tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1358 microversion: 2.1 time: 0.156659 May 13 13:31:20.946357 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 465/952] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:20 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:21.965044 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1b8d3c66-c095-427f-a010-bd075acfe2a3 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:21.967056 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1b8d3c66-c095-427f-a010-bd075acfe2a3 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:21.975722 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1b8d3c66-c095-427f-a010-bd075acfe2a3 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:21.979330 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1b8d3c66-c095-427f-a010-bd075acfe2a3 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:21.979330 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1b8d3c66-c095-427f-a010-bd075acfe2a3 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:21.979330 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1b8d3c66-c095-427f-a010-bd075acfe2a3 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:22.147198 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1b8d3c66-c095-427f-a010-bd075acfe2a3 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:22.156722 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1b8d3c66-c095-427f-a010-bd075acfe2a3 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1358 microversion: 2.1 time: 0.196728 May 13 13:31:22.157323 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 488/953] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:21 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:23.173053 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6cd99199-704a-48c7-b764-dbe255824de6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:23.173908 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6cd99199-704a-48c7-b764-dbe255824de6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:23.196411 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6cd99199-704a-48c7-b764-dbe255824de6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:23.196844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6cd99199-704a-48c7-b764-dbe255824de6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:23.197629 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6cd99199-704a-48c7-b764-dbe255824de6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:23.198060 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6cd99199-704a-48c7-b764-dbe255824de6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:23.434582 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6cd99199-704a-48c7-b764-dbe255824de6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:23.444637 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6cd99199-704a-48c7-b764-dbe255824de6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1358 microversion: 2.1 time: 0.275578 May 13 13:31:23.445386 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 466/954] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:23 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1358 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:24.462238 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e5751f82-6651-4afb-b108-86d8da789b68 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:24.462954 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e5751f82-6651-4afb-b108-86d8da789b68 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:24.470947 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e5751f82-6651-4afb-b108-86d8da789b68 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:24.479579 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e5751f82-6651-4afb-b108-86d8da789b68 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:24.479579 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e5751f82-6651-4afb-b108-86d8da789b68 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:24.479579 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e5751f82-6651-4afb-b108-86d8da789b68 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:24.606982 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e5751f82-6651-4afb-b108-86d8da789b68 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:24.614901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e5751f82-6651-4afb-b108-86d8da789b68 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1358 microversion: 2.1 time: 0.156582 May 13 13:31:24.615618 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 489/955] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:24 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:25.638399 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4d9853db-7320-400b-9db2-51b8810167c7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:25.639533 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4d9853db-7320-400b-9db2-51b8810167c7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:25.646357 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4d9853db-7320-400b-9db2-51b8810167c7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:25.647053 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4d9853db-7320-400b-9db2-51b8810167c7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:25.647825 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4d9853db-7320-400b-9db2-51b8810167c7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:25.648329 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4d9853db-7320-400b-9db2-51b8810167c7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:25.782194 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4d9853db-7320-400b-9db2-51b8810167c7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:25.789783 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4d9853db-7320-400b-9db2-51b8810167c7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1358 microversion: 2.1 time: 0.161822 May 13 13:31:25.790378 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 467/956] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:25 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:26.810686 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-983c199f-6814-425a-b4dc-d67061494d2c tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:26.810686 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-983c199f-6814-425a-b4dc-d67061494d2c tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:26.815557 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-983c199f-6814-425a-b4dc-d67061494d2c tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:26.816006 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-983c199f-6814-425a-b4dc-d67061494d2c tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:26.816935 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-983c199f-6814-425a-b4dc-d67061494d2c tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:26.817252 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-983c199f-6814-425a-b4dc-d67061494d2c tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:26.953632 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-983c199f-6814-425a-b4dc-d67061494d2c tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:26.961050 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-983c199f-6814-425a-b4dc-d67061494d2c tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1358 microversion: 2.1 time: 0.157980 May 13 13:31:26.961623 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 490/957] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:26 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:27.979877 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a599eea0-da2e-4cad-9ddc-497fecffd0dd tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:27.980541 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a599eea0-da2e-4cad-9ddc-497fecffd0dd tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:27.998147 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a599eea0-da2e-4cad-9ddc-497fecffd0dd tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:27.998984 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a599eea0-da2e-4cad-9ddc-497fecffd0dd tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:27.999963 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a599eea0-da2e-4cad-9ddc-497fecffd0dd tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:28.000611 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a599eea0-da2e-4cad-9ddc-497fecffd0dd tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:28.149191 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a599eea0-da2e-4cad-9ddc-497fecffd0dd tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:28.158945 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a599eea0-da2e-4cad-9ddc-497fecffd0dd tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1358 microversion: 2.1 time: 0.183829 May 13 13:31:28.159723 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 468/958] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:27 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:29.178879 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f6b53766-1c6c-4a6d-a9dd-5b6463386042 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:29.181493 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f6b53766-1c6c-4a6d-a9dd-5b6463386042 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:29.190165 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f6b53766-1c6c-4a6d-a9dd-5b6463386042 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:29.191604 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f6b53766-1c6c-4a6d-a9dd-5b6463386042 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:29.193072 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f6b53766-1c6c-4a6d-a9dd-5b6463386042 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:29.193688 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f6b53766-1c6c-4a6d-a9dd-5b6463386042 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:29.385156 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f6b53766-1c6c-4a6d-a9dd-5b6463386042 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:29.393492 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f6b53766-1c6c-4a6d-a9dd-5b6463386042 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1358 microversion: 2.1 time: 0.221518 May 13 13:31:29.394075 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 491/959] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:29 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:29.666797 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-381a3778-99bc-41b7-93c5-2f1734ba64bc req-6d6593ce-e5a6-430c-b52d-22afd395eaae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efaf0f78-60b2-4b3e-9d44-73149207472e", "tag": "bfe54fbd-567c-4293-a866-09fde88930de"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:29.688390 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-381a3778-99bc-41b7-93c5-2f1734ba64bc req-6d6593ce-e5a6-430c-b52d-22afd395eaae service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:29.688713 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-381a3778-99bc-41b7-93c5-2f1734ba64bc req-6d6593ce-e5a6-430c-b52d-22afd395eaae service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:29.704844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-381a3778-99bc-41b7-93c5-2f1734ba64bc req-6d6593ce-e5a6-430c-b52d-22afd395eaae service nova] Creating event network-changed:bfe54fbd-567c-4293-a866-09fde88930de for instance efaf0f78-60b2-4b3e-9d44-73149207472e on hv-cinder-84163 May 13 13:31:29.713726 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-381a3778-99bc-41b7-93c5-2f1734ba64bc req-6d6593ce-e5a6-430c-b52d-22afd395eaae service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051993 May 13 13:31:29.713726 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 469/960] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:31:30.411059 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1c7d0a1d-9888-48ec-9160-5903471082db tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:30.412414 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1c7d0a1d-9888-48ec-9160-5903471082db tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:30.420956 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1c7d0a1d-9888-48ec-9160-5903471082db tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:30.421653 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1c7d0a1d-9888-48ec-9160-5903471082db tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:30.422657 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1c7d0a1d-9888-48ec-9160-5903471082db tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:30.423399 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1c7d0a1d-9888-48ec-9160-5903471082db tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:30.580189 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1c7d0a1d-9888-48ec-9160-5903471082db tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:30.589713 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1c7d0a1d-9888-48ec-9160-5903471082db tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1358 microversion: 2.1 time: 0.182485 May 13 13:31:30.590976 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 492/961] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:30 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:31:31.610487 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a8d8fe2f-b72c-4afa-83a6-aadd7e7fd8c6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:31.611188 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a8d8fe2f-b72c-4afa-83a6-aadd7e7fd8c6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:31.618255 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a8d8fe2f-b72c-4afa-83a6-aadd7e7fd8c6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:31.619025 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a8d8fe2f-b72c-4afa-83a6-aadd7e7fd8c6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:31.620413 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a8d8fe2f-b72c-4afa-83a6-aadd7e7fd8c6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:31.620851 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a8d8fe2f-b72c-4afa-83a6-aadd7e7fd8c6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:31.761125 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a8d8fe2f-b72c-4afa-83a6-aadd7e7fd8c6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:31.768992 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a8d8fe2f-b72c-4afa-83a6-aadd7e7fd8c6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1358 microversion: 2.1 time: 0.164528 May 13 13:31:31.769571 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 470/962] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:31 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:32.792819 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c4f84d88-d6ab-4081-9261-da695ee4ce17 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:32.793580 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c4f84d88-d6ab-4081-9261-da695ee4ce17 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:32.801800 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c4f84d88-d6ab-4081-9261-da695ee4ce17 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:32.802275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c4f84d88-d6ab-4081-9261-da695ee4ce17 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:32.805849 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c4f84d88-d6ab-4081-9261-da695ee4ce17 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:32.806428 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c4f84d88-d6ab-4081-9261-da695ee4ce17 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:32.982381 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c4f84d88-d6ab-4081-9261-da695ee4ce17 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:33.010078 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c4f84d88-d6ab-4081-9261-da695ee4ce17 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1358 microversion: 2.1 time: 0.221347 May 13 13:31:33.019101 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 493/963] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:32 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:34.033986 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ae920310-17fe-4828-b5b6-7819f3f0c691 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:34.035346 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ae920310-17fe-4828-b5b6-7819f3f0c691 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:34.042570 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ae920310-17fe-4828-b5b6-7819f3f0c691 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:34.043016 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ae920310-17fe-4828-b5b6-7819f3f0c691 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:34.045145 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ae920310-17fe-4828-b5b6-7819f3f0c691 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:34.045268 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ae920310-17fe-4828-b5b6-7819f3f0c691 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:34.214538 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ae920310-17fe-4828-b5b6-7819f3f0c691 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:34.224643 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ae920310-17fe-4828-b5b6-7819f3f0c691 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1358 microversion: 2.1 time: 0.195676 May 13 13:31:34.226346 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 471/964] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:34 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:35.244624 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6c1da1b6-6c09-473a-abaf-c7cf3fb274af tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:35.247781 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6c1da1b6-6c09-473a-abaf-c7cf3fb274af tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:35.291062 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6c1da1b6-6c09-473a-abaf-c7cf3fb274af tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:35.291530 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6c1da1b6-6c09-473a-abaf-c7cf3fb274af tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:35.292432 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6c1da1b6-6c09-473a-abaf-c7cf3fb274af tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:35.292847 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6c1da1b6-6c09-473a-abaf-c7cf3fb274af tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:35.462588 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6c1da1b6-6c09-473a-abaf-c7cf3fb274af tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:35.471990 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6c1da1b6-6c09-473a-abaf-c7cf3fb274af tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1358 microversion: 2.1 time: 0.232873 May 13 13:31:35.483225 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 494/965] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:35 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:36.491180 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f87ce22e-c91a-4e3f-9293-ebe04f4e7473 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:36.491982 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f87ce22e-c91a-4e3f-9293-ebe04f4e7473 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:36.499629 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f87ce22e-c91a-4e3f-9293-ebe04f4e7473 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:36.500074 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f87ce22e-c91a-4e3f-9293-ebe04f4e7473 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:36.500882 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f87ce22e-c91a-4e3f-9293-ebe04f4e7473 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:36.501309 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f87ce22e-c91a-4e3f-9293-ebe04f4e7473 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:36.696316 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-cedee754-efe1-4bfa-85d3-d61632794e92 req-ae47f15c-bb58-46ad-b9c0-8f14933b7551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efaf0f78-60b2-4b3e-9d44-73149207472e", "name": "network-vif-plugged", "status": "completed", "tag": "bfe54fbd-567c-4293-a866-09fde88930de"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:36.710065 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-cedee754-efe1-4bfa-85d3-d61632794e92 req-ae47f15c-bb58-46ad-b9c0-8f14933b7551 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:36.710553 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-cedee754-efe1-4bfa-85d3-d61632794e92 req-ae47f15c-bb58-46ad-b9c0-8f14933b7551 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:36.740547 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-cedee754-efe1-4bfa-85d3-d61632794e92 req-ae47f15c-bb58-46ad-b9c0-8f14933b7551 service nova] Creating event network-vif-plugged:bfe54fbd-567c-4293-a866-09fde88930de for instance efaf0f78-60b2-4b3e-9d44-73149207472e on hv-cinder-84163 May 13 13:31:36.755687 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-cedee754-efe1-4bfa-85d3-d61632794e92 req-ae47f15c-bb58-46ad-b9c0-8f14933b7551 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063604 May 13 13:31:36.756818 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 495/966] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:31:36.851909 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f87ce22e-c91a-4e3f-9293-ebe04f4e7473 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:36.876854 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f87ce22e-c91a-4e3f-9293-ebe04f4e7473 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1358 microversion: 2.1 time: 0.389576 May 13 13:31:36.877472 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 472/967] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:36 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1358 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:37.895888 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3ff3d3b5-e350-41c3-9bf1-2d17fcd17754 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:37.897202 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3ff3d3b5-e350-41c3-9bf1-2d17fcd17754 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:37.909007 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3ff3d3b5-e350-41c3-9bf1-2d17fcd17754 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:37.913696 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3ff3d3b5-e350-41c3-9bf1-2d17fcd17754 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:37.917965 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3ff3d3b5-e350-41c3-9bf1-2d17fcd17754 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:37.920140 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3ff3d3b5-e350-41c3-9bf1-2d17fcd17754 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:38.165536 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3ff3d3b5-e350-41c3-9bf1-2d17fcd17754 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:38.178356 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3ff3d3b5-e350-41c3-9bf1-2d17fcd17754 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1358 microversion: 2.1 time: 0.286528 May 13 13:31:38.186039 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 496/968] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:37 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1358 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:39.205022 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-df669481-7043-4536-8cca-7462dff86af6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:39.205788 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-df669481-7043-4536-8cca-7462dff86af6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:39.217046 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-df669481-7043-4536-8cca-7462dff86af6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:39.218621 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-df669481-7043-4536-8cca-7462dff86af6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:39.223562 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-df669481-7043-4536-8cca-7462dff86af6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:39.223562 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-df669481-7043-4536-8cca-7462dff86af6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:39.747163 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-df669481-7043-4536-8cca-7462dff86af6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:39.756849 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-df669481-7043-4536-8cca-7462dff86af6 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1547 microversion: 2.1 time: 0.556729 May 13 13:31:39.759718 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 473/969] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:39 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1547 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:39.786383 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-334a4c91-2f2a-49cc-9b9b-bc3b93e42068 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:39.787093 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-334a4c91-2f2a-49cc-9b9b-bc3b93e42068 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:39.796128 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-334a4c91-2f2a-49cc-9b9b-bc3b93e42068 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:39.796750 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-334a4c91-2f2a-49cc-9b9b-bc3b93e42068 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:39.798342 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-334a4c91-2f2a-49cc-9b9b-bc3b93e42068 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:39.798901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-334a4c91-2f2a-49cc-9b9b-bc3b93e42068 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:40.004756 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-334a4c91-2f2a-49cc-9b9b-bc3b93e42068 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:40.015532 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-334a4c91-2f2a-49cc-9b9b-bc3b93e42068 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1547 microversion: 2.1 time: 0.238226 May 13 13:31:40.017157 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 497/970] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:39 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1547 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:40.037724 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d68ec884-17cd-4442-acd1-28754bdf3f54 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:40.052152 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d68ec884-17cd-4442-acd1-28754bdf3f54 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:40.056719 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d68ec884-17cd-4442-acd1-28754bdf3f54 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Searching by: {'deleted': False, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af'} {{(pid=117720) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 13 13:31:40.067601 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d68ec884-17cd-4442-acd1-28754bdf3f54 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:40.068141 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d68ec884-17cd-4442-acd1-28754bdf3f54 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:40.069355 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d68ec884-17cd-4442-acd1-28754bdf3f54 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:40.069868 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d68ec884-17cd-4442-acd1-28754bdf3f54 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:40.175416 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.multi_cell_list [None req-d68ec884-17cd-4442-acd1-28754bdf3f54 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117720) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 13 13:31:40.324095 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d68ec884-17cd-4442-acd1-28754bdf3f54 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.291825 May 13 13:31:40.331758 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 474/971] 10.222.0.13 () {58 vars in 1124 bytes} [Fri May 13 13:31:40 2022] GET /compute/v2.1/servers => generated 343 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:31:40.337452 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-fd299f27-44a2-4423-829e-8ea184fa1a6a tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:40.338312 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-fd299f27-44a2-4423-829e-8ea184fa1a6a tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:40.350187 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fd299f27-44a2-4423-829e-8ea184fa1a6a tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:40.350708 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fd299f27-44a2-4423-829e-8ea184fa1a6a tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:40.354547 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fd299f27-44a2-4423-829e-8ea184fa1a6a tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:40.356822 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fd299f27-44a2-4423-829e-8ea184fa1a6a tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:40.633614 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-fd299f27-44a2-4423-829e-8ea184fa1a6a tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:40.645985 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-fd299f27-44a2-4423-829e-8ea184fa1a6a tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1547 microversion: 2.1 time: 0.312249 May 13 13:31:40.646753 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 498/972] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:40 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1547 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:43.123759 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e71a39ee-734e-4a00-b053-7bdc807841a1 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff25dd5a-4e55-4cbd-8c11-6ad590d159a0"}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:43.125799 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e71a39ee-734e-4a00-b053-7bdc807841a1 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:43.134108 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e71a39ee-734e-4a00-b053-7bdc807841a1 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:43.134904 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e71a39ee-734e-4a00-b053-7bdc807841a1 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:43.135862 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e71a39ee-734e-4a00-b053-7bdc807841a1 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:43.136434 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e71a39ee-734e-4a00-b053-7bdc807841a1 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:43.214279 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4a1cb48a-b577-400b-ad5e-dc36ec70808a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Action: 'create', calling method: .version_select at 0x7fb0840fc4c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1117102184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpILaX83NA0muq8QhiwIkmYIV+ZBfp2qBfpLFJduBzaL2KqVriLdEhOBb9wUck1UeNIN7ggTxTdO+LSEdpiSCzt4DmaiHLRks3zjUTG3dlhX+6RUy0c4uAw/ZuipHI1Jg=="}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:43.233668 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-4a1cb48a-b577-400b-ad5e-dc36ec70808a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Getting quotas for project 6445798bd0f5475dba3878ea68e1eada. Resources: {'key_pairs'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:31:43.240219 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-4a1cb48a-b577-400b-ad5e-dc36ec70808a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Getting quotas for user 795a6f067c50494f99fea0b5afc82112 and project 6445798bd0f5475dba3878ea68e1eada. Resources: {'key_pairs'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:31:43.406091 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4a1cb48a-b577-400b-ad5e-dc36ec70808a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.456122 May 13 13:31:43.406988 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 475/973] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 13 13:31:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:31:43.909946 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e71a39ee-734e-4a00-b053-7bdc807841a1 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "POST /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.794202 May 13 13:31:43.910601 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 499/974] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 13 13:31:43 2022] POST /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e/os-volume_attachments => generated 194 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:31:51.525470 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-34372afa-a13f-4bb0-813c-3438845752f8 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:51.526211 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-34372afa-a13f-4bb0-813c-3438845752f8 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:51.558272 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34372afa-a13f-4bb0-813c-3438845752f8 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:51.559231 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34372afa-a13f-4bb0-813c-3438845752f8 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:51.561003 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34372afa-a13f-4bb0-813c-3438845752f8 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:51.561186 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34372afa-a13f-4bb0-813c-3438845752f8 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:51.700793 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-34372afa-a13f-4bb0-813c-3438845752f8 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:51.708964 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-34372afa-a13f-4bb0-813c-3438845752f8 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1593 microversion: 2.1 time: 0.187860 May 13 13:31:51.709541 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 476/975] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:51 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1593 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:52.935524 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c0f2a0b5-1587-4086-951e-155010520ace tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1323441219", "imageRef": "ece294e8-5415-4d6a-a0d3-a14539c51c0a", "flavorRef": "452", "networks": [{"uuid": "1454a409-f7b2-4338-b552-c82432c43e3a"}]}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:52.990994 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.network.neutron [None req-c0f2a0b5-1587-4086-951e-155010520ace tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] validate_networks() for [('1454a409-f7b2-4338-b552-c82432c43e3a', None, None, None, None, None)] {{(pid=117721) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:31:53.419303 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-c0f2a0b5-1587-4086-951e-155010520ace tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Flavor limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:31:53.419720 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-c0f2a0b5-1587-4086-951e-155010520ace tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Image limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:31:53.420251 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-c0f2a0b5-1587-4086-951e-155010520ace tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Flavor pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:31:53.420652 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-c0f2a0b5-1587-4086-951e-155010520ace tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Image pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:31:53.421337 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-c0f2a0b5-1587-4086-951e-155010520ace tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:31:53.431029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c0f2a0b5-1587-4086-951e-155010520ace tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:53.431556 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c0f2a0b5-1587-4086-951e-155010520ace tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:53.433507 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c0f2a0b5-1587-4086-951e-155010520ace tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:53.433507 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c0f2a0b5-1587-4086-951e-155010520ace tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:53.460708 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-c0f2a0b5-1587-4086-951e-155010520ace tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Getting quotas for project a2dfc119af794405abce655b77cb8784. Resources: {'cores', 'instances', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:31:53.466142 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-c0f2a0b5-1587-4086-951e-155010520ace tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Getting quotas for user 2440a67e143544b48850e3e9ab624a8b and project a2dfc119af794405abce655b77cb8784. Resources: {'cores', 'instances', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:31:53.479365 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c0f2a0b5-1587-4086-951e-155010520ace tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Going to run 1 instances... {{(pid=117721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:31:53.482308 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c0f2a0b5-1587-4086-951e-155010520ace tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 3339c01f-b029-478c-9c99-8f30930d0fd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ece294e8-5415-4d6a-a0d3-a14539c51c0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:31:53.617388 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c0f2a0b5-1587-4086-951e-155010520ace tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.687058 May 13 13:31:53.618115 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 500/976] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 13 13:31:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:31:53.629764 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d2e5a56b-d98a-4a00-89c1-e7db7e295687 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:53.630724 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d2e5a56b-d98a-4a00-89c1-e7db7e295687 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 3339c01f-b029-478c-9c99-8f30930d0fd7] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:53.692696 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d2e5a56b-d98a-4a00-89c1-e7db7e295687 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:53.706687 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d2e5a56b-d98a-4a00-89c1-e7db7e295687 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7" status: 200 len: 1214 microversion: 2.1 time: 0.081240 May 13 13:31:53.707736 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 477/977] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:53 2022] GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:54.369745 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-26378a3e-6598-40e6-ab33-f2f402b5bd4f req-f803e3b9-36fe-45fb-a0fd-794a5e6c1c04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efaf0f78-60b2-4b3e-9d44-73149207472e", "tag": "bfe54fbd-567c-4293-a866-09fde88930de"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:54.380443 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-26378a3e-6598-40e6-ab33-f2f402b5bd4f req-f803e3b9-36fe-45fb-a0fd-794a5e6c1c04 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:54.380889 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-26378a3e-6598-40e6-ab33-f2f402b5bd4f req-f803e3b9-36fe-45fb-a0fd-794a5e6c1c04 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:54.402992 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-26378a3e-6598-40e6-ab33-f2f402b5bd4f req-f803e3b9-36fe-45fb-a0fd-794a5e6c1c04 service nova] Creating event network-changed:bfe54fbd-567c-4293-a866-09fde88930de for instance efaf0f78-60b2-4b3e-9d44-73149207472e on hv-cinder-84163 May 13 13:31:54.411976 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-26378a3e-6598-40e6-ab33-f2f402b5bd4f req-f803e3b9-36fe-45fb-a0fd-794a5e6c1c04 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045790 May 13 13:31:54.412588 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 501/978] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:31:54.725516 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e204f8dc-6025-4be6-8f59-e09b8883d493 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:54.726291 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e204f8dc-6025-4be6-8f59-e09b8883d493 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 3339c01f-b029-478c-9c99-8f30930d0fd7] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:54.802379 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e204f8dc-6025-4be6-8f59-e09b8883d493 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:54.810307 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e204f8dc-6025-4be6-8f59-e09b8883d493 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7" status: 200 len: 1214 microversion: 2.1 time: 0.088613 May 13 13:31:54.811148 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 478/979] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:54 2022] GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:55.828468 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-18122e14-face-4c2c-b0f6-f8f4291b62c2 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:55.829389 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-18122e14-face-4c2c-b0f6-f8f4291b62c2 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 3339c01f-b029-478c-9c99-8f30930d0fd7] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:55.836401 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-18122e14-face-4c2c-b0f6-f8f4291b62c2 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:55.839704 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-18122e14-face-4c2c-b0f6-f8f4291b62c2 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:55.839704 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-18122e14-face-4c2c-b0f6-f8f4291b62c2 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:55.839704 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-18122e14-face-4c2c-b0f6-f8f4291b62c2 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:55.905028 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-18122e14-face-4c2c-b0f6-f8f4291b62c2 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:55.912673 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-18122e14-face-4c2c-b0f6-f8f4291b62c2 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7" status: 200 len: 1266 microversion: 2.1 time: 0.089725 May 13 13:31:55.913249 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 502/980] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:55 2022] GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:56.941956 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-edd82e3b-a6e0-4cf8-aaf0-8aa6b9a9986a tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:56.942608 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-edd82e3b-a6e0-4cf8-aaf0-8aa6b9a9986a tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 3339c01f-b029-478c-9c99-8f30930d0fd7] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:56.957721 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-edd82e3b-a6e0-4cf8-aaf0-8aa6b9a9986a tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:56.958313 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-edd82e3b-a6e0-4cf8-aaf0-8aa6b9a9986a tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:56.959041 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-edd82e3b-a6e0-4cf8-aaf0-8aa6b9a9986a tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:56.959481 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-edd82e3b-a6e0-4cf8-aaf0-8aa6b9a9986a tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:57.305572 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-edd82e3b-a6e0-4cf8-aaf0-8aa6b9a9986a tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:57.314298 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-edd82e3b-a6e0-4cf8-aaf0-8aa6b9a9986a tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7" status: 200 len: 1314 microversion: 2.1 time: 0.382955 May 13 13:31:57.314886 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 479/981] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:56 2022] GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:57.717354 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-92c3c494-6d1b-4b88-8c75-05ba8980101a tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1179136651"}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:57.717932 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-92c3c494-6d1b-4b88-8c75-05ba8980101a tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:57.725949 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-92c3c494-6d1b-4b88-8c75-05ba8980101a tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:57.730562 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-92c3c494-6d1b-4b88-8c75-05ba8980101a tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:57.730562 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-92c3c494-6d1b-4b88-8c75-05ba8980101a tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:57.730562 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-92c3c494-6d1b-4b88-8c75-05ba8980101a tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:57.882254 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.network.security_group_api [None req-92c3c494-6d1b-4b88-8c75-05ba8980101a tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Adding security group e6009097-74fd-4fa4-aeb7-a5dd8874e7d3 to port bfe54fbd-567c-4293-a866-09fde88930de May 13 13:31:58.332406 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-532fd74e-e8b0-4391-80ef-8911a9147e2b tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:58.333719 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-532fd74e-e8b0-4391-80ef-8911a9147e2b tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 3339c01f-b029-478c-9c99-8f30930d0fd7] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:58.342962 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-532fd74e-e8b0-4391-80ef-8911a9147e2b tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:58.350375 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-532fd74e-e8b0-4391-80ef-8911a9147e2b tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:58.351662 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-532fd74e-e8b0-4391-80ef-8911a9147e2b tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:58.352110 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-532fd74e-e8b0-4391-80ef-8911a9147e2b tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:58.379590 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-92c3c494-6d1b-4b88-8c75-05ba8980101a tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "POST /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e/action" status: 202 len: 0 microversion: 2.1 time: 0.666814 May 13 13:31:58.384791 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 503/982] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 13 13:31:57 2022] POST /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e/action => generated 0 bytes in 673 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:31:58.392269 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-164ff653-8f11-46b8-b460-bbfbeb5c2d49 req-3482437c-5fb7-4837-8623-014831a8f6cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3339c01f-b029-478c-9c99-8f30930d0fd7", "tag": "8439911a-78cd-4fa3-b65b-7cc08832a070"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:58.402461 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-164ff653-8f11-46b8-b460-bbfbeb5c2d49 req-3482437c-5fb7-4837-8623-014831a8f6cd service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:58.403113 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-164ff653-8f11-46b8-b460-bbfbeb5c2d49 req-3482437c-5fb7-4837-8623-014831a8f6cd service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:58.427774 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-164ff653-8f11-46b8-b460-bbfbeb5c2d49 req-3482437c-5fb7-4837-8623-014831a8f6cd service nova] Creating event network-changed:8439911a-78cd-4fa3-b65b-7cc08832a070 for instance 3339c01f-b029-478c-9c99-8f30930d0fd7 on hv-cinder-84163 May 13 13:31:58.433906 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-164ff653-8f11-46b8-b460-bbfbeb5c2d49 req-3482437c-5fb7-4837-8623-014831a8f6cd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047630 May 13 13:31:58.435524 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 504/983] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:31:58.447470 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-bc714774-4cc3-40f6-abed-688d765188d7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:58.448641 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-bc714774-4cc3-40f6-abed-688d765188d7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:58.456517 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bc714774-4cc3-40f6-abed-688d765188d7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:58.457158 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bc714774-4cc3-40f6-abed-688d765188d7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:58.458718 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bc714774-4cc3-40f6-abed-688d765188d7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:58.462098 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bc714774-4cc3-40f6-abed-688d765188d7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:58.646817 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-532fd74e-e8b0-4391-80ef-8911a9147e2b tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:58.665867 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-532fd74e-e8b0-4391-80ef-8911a9147e2b tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7" status: 200 len: 1314 microversion: 2.1 time: 0.337064 May 13 13:31:58.667258 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 480/984] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:58 2022] GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:58.735479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-bc714774-4cc3-40f6-abed-688d765188d7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:58.742512 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-bc714774-4cc3-40f6-abed-688d765188d7 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1759 microversion: 2.1 time: 0.303416 May 13 13:31:58.743172 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 505/985] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:58 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1759 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:58.845657 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-46ee3ac1-7917-4fd7-a5bc-8742c19a8472 req-4c00ea2b-d022-4b5d-af94-1f20cd42bdfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efaf0f78-60b2-4b3e-9d44-73149207472e", "tag": "bfe54fbd-567c-4293-a866-09fde88930de"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:58.854439 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-46ee3ac1-7917-4fd7-a5bc-8742c19a8472 req-4c00ea2b-d022-4b5d-af94-1f20cd42bdfb service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:58.855026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-46ee3ac1-7917-4fd7-a5bc-8742c19a8472 req-4c00ea2b-d022-4b5d-af94-1f20cd42bdfb service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:58.869036 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-46ee3ac1-7917-4fd7-a5bc-8742c19a8472 req-4c00ea2b-d022-4b5d-af94-1f20cd42bdfb service nova] Creating event network-changed:bfe54fbd-567c-4293-a866-09fde88930de for instance efaf0f78-60b2-4b3e-9d44-73149207472e on hv-cinder-84163 May 13 13:31:58.876642 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-46ee3ac1-7917-4fd7-a5bc-8742c19a8472 req-4c00ea2b-d022-4b5d-af94-1f20cd42bdfb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195926 May 13 13:31:58.877751 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 481/986] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:31:59.684418 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f59ba7bf-3933-45d6-818e-60ed0d5d9e31 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:59.684936 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f59ba7bf-3933-45d6-818e-60ed0d5d9e31 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 3339c01f-b029-478c-9c99-8f30930d0fd7] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:59.691078 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f59ba7bf-3933-45d6-818e-60ed0d5d9e31 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:59.691521 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f59ba7bf-3933-45d6-818e-60ed0d5d9e31 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:59.692406 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f59ba7bf-3933-45d6-818e-60ed0d5d9e31 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:59.692839 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f59ba7bf-3933-45d6-818e-60ed0d5d9e31 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:59.829222 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f59ba7bf-3933-45d6-818e-60ed0d5d9e31 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:59.836758 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f59ba7bf-3933-45d6-818e-60ed0d5d9e31 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7" status: 200 len: 1314 microversion: 2.1 time: 0.156242 May 13 13:31:59.837324 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 506/987] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:31:59 2022] GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:00.854964 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-313aa96b-9175-4e5f-84f9-158e26e7f686 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:00.855659 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-313aa96b-9175-4e5f-84f9-158e26e7f686 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 3339c01f-b029-478c-9c99-8f30930d0fd7] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:00.862574 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-313aa96b-9175-4e5f-84f9-158e26e7f686 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:00.863018 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-313aa96b-9175-4e5f-84f9-158e26e7f686 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:00.863822 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-313aa96b-9175-4e5f-84f9-158e26e7f686 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:00.864243 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-313aa96b-9175-4e5f-84f9-158e26e7f686 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:00.998759 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-313aa96b-9175-4e5f-84f9-158e26e7f686 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:01.006232 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-313aa96b-9175-4e5f-84f9-158e26e7f686 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7" status: 200 len: 1314 microversion: 2.1 time: 0.155932 May 13 13:32:01.006806 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 482/988] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:00 2022] GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:02.023905 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c32130a3-6336-4d7e-b97d-cd214dde0672 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:02.024493 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c32130a3-6336-4d7e-b97d-cd214dde0672 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 3339c01f-b029-478c-9c99-8f30930d0fd7] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:02.031949 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c32130a3-6336-4d7e-b97d-cd214dde0672 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:02.032402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c32130a3-6336-4d7e-b97d-cd214dde0672 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:02.033217 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c32130a3-6336-4d7e-b97d-cd214dde0672 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:02.033656 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c32130a3-6336-4d7e-b97d-cd214dde0672 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:02.167300 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c32130a3-6336-4d7e-b97d-cd214dde0672 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:02.175402 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c32130a3-6336-4d7e-b97d-cd214dde0672 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7" status: 200 len: 1314 microversion: 2.1 time: 0.155347 May 13 13:32:02.175983 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 507/989] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:02 2022] GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:02.580227 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-bbf0defe-1a36-41d0-95ef-0a2f32004ee5 req-13818fdf-0158-4652-9417-61a8a1eff7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3339c01f-b029-478c-9c99-8f30930d0fd7", "name": "network-vif-plugged", "status": "completed", "tag": "8439911a-78cd-4fa3-b65b-7cc08832a070"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:02.588692 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-bbf0defe-1a36-41d0-95ef-0a2f32004ee5 req-13818fdf-0158-4652-9417-61a8a1eff7f7 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:02.591813 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-bbf0defe-1a36-41d0-95ef-0a2f32004ee5 req-13818fdf-0158-4652-9417-61a8a1eff7f7 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:02.601458 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-bbf0defe-1a36-41d0-95ef-0a2f32004ee5 req-13818fdf-0158-4652-9417-61a8a1eff7f7 service nova] Creating event network-vif-plugged:8439911a-78cd-4fa3-b65b-7cc08832a070 for instance 3339c01f-b029-478c-9c99-8f30930d0fd7 on hv-cinder-84163 May 13 13:32:02.607880 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-bbf0defe-1a36-41d0-95ef-0a2f32004ee5 req-13818fdf-0158-4652-9417-61a8a1eff7f7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031852 May 13 13:32:02.608651 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 483/990] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:32:03.195009 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8097212c-7862-4864-a893-6ff108711ad8 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:03.195861 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8097212c-7862-4864-a893-6ff108711ad8 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 3339c01f-b029-478c-9c99-8f30930d0fd7] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:03.205666 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8097212c-7862-4864-a893-6ff108711ad8 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:03.206492 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8097212c-7862-4864-a893-6ff108711ad8 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:03.207705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8097212c-7862-4864-a893-6ff108711ad8 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:03.208154 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8097212c-7862-4864-a893-6ff108711ad8 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:03.348973 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8097212c-7862-4864-a893-6ff108711ad8 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:03.357779 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8097212c-7862-4864-a893-6ff108711ad8 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7" status: 200 len: 1314 microversion: 2.1 time: 0.168819 May 13 13:32:03.358384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 508/991] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:03 2022] GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:04.376900 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-fcae8b6f-2cb1-4a2b-986b-407d98401c2b tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:04.377722 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-fcae8b6f-2cb1-4a2b-986b-407d98401c2b tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 3339c01f-b029-478c-9c99-8f30930d0fd7] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:04.384397 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fcae8b6f-2cb1-4a2b-986b-407d98401c2b tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:04.384975 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fcae8b6f-2cb1-4a2b-986b-407d98401c2b tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:04.385694 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fcae8b6f-2cb1-4a2b-986b-407d98401c2b tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:04.386124 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fcae8b6f-2cb1-4a2b-986b-407d98401c2b tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:04.525867 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fcae8b6f-2cb1-4a2b-986b-407d98401c2b tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:04.533944 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-fcae8b6f-2cb1-4a2b-986b-407d98401c2b tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7" status: 200 len: 1314 microversion: 2.1 time: 0.162645 May 13 13:32:04.565481 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 484/992] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:04 2022] GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:04.869237 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-be998028-7f93-43f9-85fb-bbe4f4c81277 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1018790347", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1117102184", "security_groups": [{"name": "tempest-secgroup-smoke-1011461249"}], "block_device_mapping_v2": [{"uuid": "3dc1291a-4804-460a-b190-4f32766a55ef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f93163e1-e8a9-4aac-a1de-53c0262bf902"}]}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:04.981928 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.network.neutron [None req-be998028-7f93-43f9-85fb-bbe4f4c81277 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] validate_networks() for [('f93163e1-e8a9-4aac-a1de-53c0262bf902', None, None, None, None, None)] {{(pid=117721) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:32:05.363199 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-be998028-7f93-43f9-85fb-bbe4f4c81277 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Flavor limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:32:05.363622 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-be998028-7f93-43f9-85fb-bbe4f4c81277 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Image limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:32:05.364092 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-be998028-7f93-43f9-85fb-bbe4f4c81277 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Flavor pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:32:05.364562 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-be998028-7f93-43f9-85fb-bbe4f4c81277 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Image pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:32:05.364973 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-be998028-7f93-43f9-85fb-bbe4f4c81277 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:32:05.373915 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-be998028-7f93-43f9-85fb-bbe4f4c81277 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:05.374469 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-be998028-7f93-43f9-85fb-bbe4f4c81277 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:05.375274 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-be998028-7f93-43f9-85fb-bbe4f4c81277 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:05.375722 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-be998028-7f93-43f9-85fb-bbe4f4c81277 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:05.393270 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-be998028-7f93-43f9-85fb-bbe4f4c81277 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Getting quotas for project 6445798bd0f5475dba3878ea68e1eada. Resources: {'cores', 'instances', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:32:05.397157 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-be998028-7f93-43f9-85fb-bbe4f4c81277 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Getting quotas for user 795a6f067c50494f99fea0b5afc82112 and project 6445798bd0f5475dba3878ea68e1eada. Resources: {'cores', 'instances', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:32:05.459252 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-be998028-7f93-43f9-85fb-bbe4f4c81277 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Going to run 1 instances... {{(pid=117721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:32:05.459252 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-be998028-7f93-43f9-85fb-bbe4f4c81277 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3dc1291a-4804-460a-b190-4f32766a55ef',volume_size=None,volume_type=None)] {{(pid=117721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:32:05.552086 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-83506a6d-dd51-4114-957a-974faa6df76e tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:05.559952 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-83506a6d-dd51-4114-957a-974faa6df76e tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 3339c01f-b029-478c-9c99-8f30930d0fd7] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:05.559952 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-83506a6d-dd51-4114-957a-974faa6df76e tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:05.560297 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-83506a6d-dd51-4114-957a-974faa6df76e tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:05.560798 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-83506a6d-dd51-4114-957a-974faa6df76e tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:05.561232 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-83506a6d-dd51-4114-957a-974faa6df76e tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:05.712054 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-83506a6d-dd51-4114-957a-974faa6df76e tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:05.720631 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-83506a6d-dd51-4114-957a-974faa6df76e tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7" status: 200 len: 1498 microversion: 2.1 time: 0.172616 May 13 13:32:05.721200 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 485/993] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:05 2022] GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7 => generated 1498 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:05.988485 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-be998028-7f93-43f9-85fb-bbe4f4c81277 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.122992 May 13 13:32:05.990311 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 509/994] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 13 13:32:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:32:06.000910 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-dbeeccef-ff92-4a38-af5c-7ba161a39492 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:06.001640 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-dbeeccef-ff92-4a38-af5c-7ba161a39492 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:06.055921 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dbeeccef-ff92-4a38-af5c-7ba161a39492 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:06.064103 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-dbeeccef-ff92-4a38-af5c-7ba161a39492 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f" status: 200 len: 1095 microversion: 2.1 time: 0.068374 May 13 13:32:06.068116 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 486/995] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:05 2022] GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:06.613302 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-af9da5aa-4473-43d3-a7fa-78db7210af65 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:06.613797 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-af9da5aa-4473-43d3-a7fa-78db7210af65 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 3339c01f-b029-478c-9c99-8f30930d0fd7] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:06.619977 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af9da5aa-4473-43d3-a7fa-78db7210af65 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:06.620425 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af9da5aa-4473-43d3-a7fa-78db7210af65 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:06.621205 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af9da5aa-4473-43d3-a7fa-78db7210af65 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:06.622113 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af9da5aa-4473-43d3-a7fa-78db7210af65 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:06.647174 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-af9da5aa-4473-43d3-a7fa-78db7210af65 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 3339c01f-b029-478c-9c99-8f30930d0fd7] Going to try to terminate instance {{(pid=117721) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:32:06.889089 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-af9da5aa-4473-43d3-a7fa-78db7210af65 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7" status: 204 len: 0 microversion: 2.1 time: 0.279399 May 13 13:32:06.889678 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 510/996] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:32:06 2022] DELETE /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:32:06.897881 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d6eb099b-c8e2-4f0f-89ab-54bbe2a22bda tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:06.900265 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d6eb099b-c8e2-4f0f-89ab-54bbe2a22bda tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 3339c01f-b029-478c-9c99-8f30930d0fd7] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:06.905793 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d6eb099b-c8e2-4f0f-89ab-54bbe2a22bda tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:06.906294 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d6eb099b-c8e2-4f0f-89ab-54bbe2a22bda tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:06.907067 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d6eb099b-c8e2-4f0f-89ab-54bbe2a22bda tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:06.907502 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d6eb099b-c8e2-4f0f-89ab-54bbe2a22bda tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:07.037532 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d6eb099b-c8e2-4f0f-89ab-54bbe2a22bda tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:07.045595 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d6eb099b-c8e2-4f0f-89ab-54bbe2a22bda tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7" status: 200 len: 1504 microversion: 2.1 time: 0.151544 May 13 13:32:07.046117 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 487/997] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:06 2022] GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:07.082679 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6e5eb62b-505d-4ff8-9daf-fe3069995dba tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:07.083374 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6e5eb62b-505d-4ff8-9daf-fe3069995dba tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:07.089561 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6e5eb62b-505d-4ff8-9daf-fe3069995dba tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:07.090004 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6e5eb62b-505d-4ff8-9daf-fe3069995dba tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:07.092172 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6e5eb62b-505d-4ff8-9daf-fe3069995dba tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:07.092611 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6e5eb62b-505d-4ff8-9daf-fe3069995dba tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:07.158276 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6e5eb62b-505d-4ff8-9daf-fe3069995dba tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:07.165689 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6e5eb62b-505d-4ff8-9daf-fe3069995dba tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f" status: 200 len: 1145 microversion: 2.1 time: 0.087406 May 13 13:32:07.166310 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 511/998] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:07 2022] GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:08.063743 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4ad760d1-c517-4049-bbd2-d3fedc36332e tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:08.064368 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4ad760d1-c517-4049-bbd2-d3fedc36332e tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 3339c01f-b029-478c-9c99-8f30930d0fd7] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:08.070756 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4ad760d1-c517-4049-bbd2-d3fedc36332e tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:08.071198 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4ad760d1-c517-4049-bbd2-d3fedc36332e tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:08.071964 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4ad760d1-c517-4049-bbd2-d3fedc36332e tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:08.072390 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4ad760d1-c517-4049-bbd2-d3fedc36332e tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:08.183889 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d0d31b30-460e-4c80-8797-139208c903ac tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:08.184857 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d0d31b30-460e-4c80-8797-139208c903ac tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:08.194052 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d0d31b30-460e-4c80-8797-139208c903ac tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:08.194878 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d0d31b30-460e-4c80-8797-139208c903ac tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:08.195681 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d0d31b30-460e-4c80-8797-139208c903ac tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:08.196121 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d0d31b30-460e-4c80-8797-139208c903ac tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:08.250590 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4ad760d1-c517-4049-bbd2-d3fedc36332e tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:08.264382 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4ad760d1-c517-4049-bbd2-d3fedc36332e tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7" status: 200 len: 1504 microversion: 2.1 time: 0.204955 May 13 13:32:08.281353 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 488/999] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:08 2022] GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7 => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:08.302921 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d0d31b30-460e-4c80-8797-139208c903ac tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:08.309383 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d0d31b30-460e-4c80-8797-139208c903ac tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f" status: 200 len: 1145 microversion: 2.1 time: 0.129117 May 13 13:32:08.310181 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 512/1000] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:08 2022] GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f => generated 1145 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:08.904121 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-d3b73561-9d43-4c79-9291-b6dba0ee272e req-17e9b7b1-4ac4-4c4e-a980-ad03c198ea12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3339c01f-b029-478c-9c99-8f30930d0fd7", "name": "network-vif-deleted", "tag": "8439911a-78cd-4fa3-b65b-7cc08832a070"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:08.912310 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-d3b73561-9d43-4c79-9291-b6dba0ee272e req-17e9b7b1-4ac4-4c4e-a980-ad03c198ea12 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:08.912748 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-d3b73561-9d43-4c79-9291-b6dba0ee272e req-17e9b7b1-4ac4-4c4e-a980-ad03c198ea12 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:08.924156 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-d3b73561-9d43-4c79-9291-b6dba0ee272e req-17e9b7b1-4ac4-4c4e-a980-ad03c198ea12 service nova] Creating event network-vif-deleted:8439911a-78cd-4fa3-b65b-7cc08832a070 for instance 3339c01f-b029-478c-9c99-8f30930d0fd7 on hv-cinder-84163 May 13 13:32:08.929077 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-d3b73561-9d43-4c79-9291-b6dba0ee272e req-17e9b7b1-4ac4-4c4e-a980-ad03c198ea12 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029004 May 13 13:32:08.930676 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 489/1001] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:32:09.282350 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2b7c8ed7-9a6d-4ec1-9ecc-1674ccbf80f1 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:09.282974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2b7c8ed7-9a6d-4ec1-9ecc-1674ccbf80f1 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 3339c01f-b029-478c-9c99-8f30930d0fd7] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:09.289705 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2b7c8ed7-9a6d-4ec1-9ecc-1674ccbf80f1 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:09.296915 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2b7c8ed7-9a6d-4ec1-9ecc-1674ccbf80f1 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:09.296915 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2b7c8ed7-9a6d-4ec1-9ecc-1674ccbf80f1 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:09.296915 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2b7c8ed7-9a6d-4ec1-9ecc-1674ccbf80f1 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:09.329417 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1266eb7a-8133-464d-9f46-8560d7c04240 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:09.331476 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1266eb7a-8133-464d-9f46-8560d7c04240 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:09.339038 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1266eb7a-8133-464d-9f46-8560d7c04240 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:09.339741 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1266eb7a-8133-464d-9f46-8560d7c04240 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:09.341167 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1266eb7a-8133-464d-9f46-8560d7c04240 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:09.341997 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1266eb7a-8133-464d-9f46-8560d7c04240 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:09.357853 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2b7c8ed7-9a6d-4ec1-9ecc-1674ccbf80f1 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:09.367238 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2b7c8ed7-9a6d-4ec1-9ecc-1674ccbf80f1 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7" status: 200 len: 1299 microversion: 2.1 time: 0.088908 May 13 13:32:09.367873 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 513/1002] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:09 2022] GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:09.415678 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1266eb7a-8133-464d-9f46-8560d7c04240 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:09.425698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1266eb7a-8133-464d-9f46-8560d7c04240 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f" status: 200 len: 1201 microversion: 2.1 time: 0.102478 May 13 13:32:09.426309 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 490/1003] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:09 2022] GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f => generated 1201 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:10.385057 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-523e6dc7-603b-4812-8258-0b5bf841b0ec tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:10.385711 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-523e6dc7-603b-4812-8258-0b5bf841b0ec tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 3339c01f-b029-478c-9c99-8f30930d0fd7] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:10.399916 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-523e6dc7-603b-4812-8258-0b5bf841b0ec tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:10.400362 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-523e6dc7-603b-4812-8258-0b5bf841b0ec tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:10.401145 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-523e6dc7-603b-4812-8258-0b5bf841b0ec tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:10.401576 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-523e6dc7-603b-4812-8258-0b5bf841b0ec tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:10.419301 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-523e6dc7-603b-4812-8258-0b5bf841b0ec tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] HTTP exception thrown: Instance 3339c01f-b029-478c-9c99-8f30930d0fd7 could not be found. May 13 13:32:10.425129 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-523e6dc7-603b-4812-8258-0b5bf841b0ec tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Request method failure captured: May 13 13:32:10.425129 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7 HTTP/1.1 May 13 13:32:10.425129 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:32:10.425129 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:32:10.425129 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:32:10.425129 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:32:10.425129 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:32:10.425129 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:32:10.425129 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:32:10.425129 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:32:10.425129 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABifl3GC-wVtzHBq8DQvi1XyBVjSqW5geH8nebqDvfSn0rIh3K3rSdLOg2VprhzIeHZfQHW-jxDz5vehcEEZ6dbx3BsM3V7qSfXgdd_BqSw-YOLn9-vSd5bIiOr-vS4J6Z3ufGOHkoclVrFksz6XLTiTKTT7a4EGnHW5ZHBgPNrv0Nzecg May 13 13:32:10.425129 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:32:10.425129 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:32:10.425129 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:32:10.425129 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:32:10.425129 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:32:10.425129 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:32:10.425129 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: a2dfc119af794405abce655b77cb8784 May 13 13:32:10.425129 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-VolumesActionsTest-1345630934 May 13 13:32:10.425129 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:32:10.425129 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:32:10.426980 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a2dfc119af794405abce655b77cb8784", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a2dfc119af794405abce655b77cb8784"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a2dfc119af794405abce655b77cb8784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a2dfc119af794405abce655b77cb8784"}]}] May 13 13:32:10.426980 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-VolumesActionsTest-1345630934 May 13 13:32:10.426980 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: a2dfc119af794405abce655b77cb8784 May 13 13:32:10.426980 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-VolumesActionsTest-1345630934 May 13 13:32:10.426980 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-VolumesActionsTest-1345630934-project May 13 13:32:10.426980 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:32:10.426980 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:32:10.426980 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: 2440a67e143544b48850e3e9ab624a8b May 13 13:32:10.426980 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-VolumesActionsTest-1345630934-project May 13 13:32:10.426980 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: > May 13 13:32:10.426980 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Instance 3339c01f-b029-478c-9c99-8f30930d0fd7 could not be found. May 13 13:32:10.426980 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': '3339c01f-b029-478c-9c99-8f30930d0fd7'} May 13 13:32:10.427918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:32:10.427918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:10.427918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:32:10.427918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:32:10.427918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:32:10.427918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:32:10.427918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:32:10.427918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:32:10.427918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:32:10.427918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:32:10.427918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3339c01f-b029-478c-9c99-8f30930d0fd7 could not be found. May 13 13:32:10.427918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:32:10.427918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:10.427918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:32:10.427918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:10.427918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:10.427918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:10.427918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:32:10.427918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:32:10.427918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:32:10.429245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:32:10.429245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:32:10.429245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:32:10.429245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:32:10.429245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:32:10.429245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:32:10.429245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:32:10.429245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3339c01f-b029-478c-9c99-8f30930d0fd7 could not be found. May 13 13:32:10.429245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:32:10.429245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:10.429245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:32:10.429245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:10.429245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:10.429245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:10.429245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:32:10.429245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:32:10.429245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3339c01f-b029-478c-9c99-8f30930d0fd7 could not be found. May 13 13:32:10.429245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:32:10.431019 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-523e6dc7-603b-4812-8258-0b5bf841b0ec tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Returning 404 to user: Instance 3339c01f-b029-478c-9c99-8f30930d0fd7 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:32:10.431019 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-523e6dc7-603b-4812-8258-0b5bf841b0ec tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7" status: 404 len: 111 microversion: 2.1 time: 0.041326 May 13 13:32:10.431019 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 514/1004] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:10 2022] GET /compute/v2.1/servers/3339c01f-b029-478c-9c99-8f30930d0fd7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:32:10.444060 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d72c3c24-d09c-4461-bedd-8a07d455549e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:10.444768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d72c3c24-d09c-4461-bedd-8a07d455549e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:10.452854 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d72c3c24-d09c-4461-bedd-8a07d455549e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:10.453953 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d72c3c24-d09c-4461-bedd-8a07d455549e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:10.454978 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d72c3c24-d09c-4461-bedd-8a07d455549e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:10.455583 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d72c3c24-d09c-4461-bedd-8a07d455549e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:10.488162 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3ca44b07-d0a5-4573-8f9a-fc63a1a6cb15 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-966239829", "imageRef": "ece294e8-5415-4d6a-a0d3-a14539c51c0a", "flavorRef": "452", "networks": [{"uuid": "1454a409-f7b2-4338-b552-c82432c43e3a"}]}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:10.548062 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.network.neutron [None req-3ca44b07-d0a5-4573-8f9a-fc63a1a6cb15 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] validate_networks() for [('1454a409-f7b2-4338-b552-c82432c43e3a', None, None, None, None, None)] {{(pid=117721) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:32:10.926271 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d72c3c24-d09c-4461-bedd-8a07d455549e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:10.934508 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d72c3c24-d09c-4461-bedd-8a07d455549e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f" status: 200 len: 1279 microversion: 2.1 time: 0.495052 May 13 13:32:10.944905 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 491/1005] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:10 2022] GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f => generated 1279 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:11.228070 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-3ca44b07-d0a5-4573-8f9a-fc63a1a6cb15 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Flavor limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:32:11.228513 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-3ca44b07-d0a5-4573-8f9a-fc63a1a6cb15 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Image limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:32:11.228982 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-3ca44b07-d0a5-4573-8f9a-fc63a1a6cb15 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Flavor pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:32:11.229428 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-3ca44b07-d0a5-4573-8f9a-fc63a1a6cb15 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Image pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:32:11.229848 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-3ca44b07-d0a5-4573-8f9a-fc63a1a6cb15 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:32:11.241667 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3ca44b07-d0a5-4573-8f9a-fc63a1a6cb15 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:11.242108 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3ca44b07-d0a5-4573-8f9a-fc63a1a6cb15 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:11.242954 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3ca44b07-d0a5-4573-8f9a-fc63a1a6cb15 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:11.243384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3ca44b07-d0a5-4573-8f9a-fc63a1a6cb15 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:11.261509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-3ca44b07-d0a5-4573-8f9a-fc63a1a6cb15 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Getting quotas for project a2dfc119af794405abce655b77cb8784. Resources: {'cores', 'instances', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:32:11.267011 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-3ca44b07-d0a5-4573-8f9a-fc63a1a6cb15 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Getting quotas for user 2440a67e143544b48850e3e9ab624a8b and project a2dfc119af794405abce655b77cb8784. Resources: {'cores', 'instances', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:32:11.280649 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3ca44b07-d0a5-4573-8f9a-fc63a1a6cb15 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Going to run 1 instances... {{(pid=117721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:32:11.282975 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3ca44b07-d0a5-4573-8f9a-fc63a1a6cb15 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 08c6080c-b39d-43f6-af1f-8707f33d3476] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ece294e8-5415-4d6a-a0d3-a14539c51c0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:32:11.383245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3ca44b07-d0a5-4573-8f9a-fc63a1a6cb15 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.901702 May 13 13:32:11.383245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 515/1006] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 13 13:32:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 13:32:11.400143 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9335632b-ad7a-4306-abd7-ef339d9cdbcb tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:11.400880 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9335632b-ad7a-4306-abd7-ef339d9cdbcb tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 08c6080c-b39d-43f6-af1f-8707f33d3476] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:11.472520 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9335632b-ad7a-4306-abd7-ef339d9cdbcb tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:11.481489 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9335632b-ad7a-4306-abd7-ef339d9cdbcb tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476" status: 200 len: 1213 microversion: 2.1 time: 0.085188 May 13 13:32:11.482182 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 492/1007] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:11 2022] GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:11.824004 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-3880dcee-4269-41f9-a041-d90ed2f18dc7 req-2e8909f1-39aa-4ecf-aef5-5b36f08153d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4c37c70-bc64-4dc6-92eb-41a9df5a319f", "tag": "e4cad75c-2de5-45aa-88b3-e937529cf2a8"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:11.836027 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-3880dcee-4269-41f9-a041-d90ed2f18dc7 req-2e8909f1-39aa-4ecf-aef5-5b36f08153d5 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:11.840716 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-3880dcee-4269-41f9-a041-d90ed2f18dc7 req-2e8909f1-39aa-4ecf-aef5-5b36f08153d5 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:11.850954 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-3880dcee-4269-41f9-a041-d90ed2f18dc7 req-2e8909f1-39aa-4ecf-aef5-5b36f08153d5 service nova] Creating event network-changed:e4cad75c-2de5-45aa-88b3-e937529cf2a8 for instance a4c37c70-bc64-4dc6-92eb-41a9df5a319f on hv-cinder-84163 May 13 13:32:11.856559 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-3880dcee-4269-41f9-a041-d90ed2f18dc7 req-2e8909f1-39aa-4ecf-aef5-5b36f08153d5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037374 May 13 13:32:11.857448 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 516/1008] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:32:11.953094 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-539f03c4-3d9d-4eef-8553-cae4484ee8dd tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:11.953712 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-539f03c4-3d9d-4eef-8553-cae4484ee8dd tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:11.961037 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-539f03c4-3d9d-4eef-8553-cae4484ee8dd tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:11.961649 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-539f03c4-3d9d-4eef-8553-cae4484ee8dd tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:11.962476 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-539f03c4-3d9d-4eef-8553-cae4484ee8dd tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:11.962915 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-539f03c4-3d9d-4eef-8553-cae4484ee8dd tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:12.110110 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-539f03c4-3d9d-4eef-8553-cae4484ee8dd tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:12.117897 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-539f03c4-3d9d-4eef-8553-cae4484ee8dd tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f" status: 200 len: 1267 microversion: 2.1 time: 0.169552 May 13 13:32:12.118509 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 493/1009] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:11 2022] GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:12.499609 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7af1c0a2-faf4-460c-b082-19b83b12cf0f tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:12.502436 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7af1c0a2-faf4-460c-b082-19b83b12cf0f tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 08c6080c-b39d-43f6-af1f-8707f33d3476] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:12.506936 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7af1c0a2-faf4-460c-b082-19b83b12cf0f tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:12.507386 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7af1c0a2-faf4-460c-b082-19b83b12cf0f tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:12.508162 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7af1c0a2-faf4-460c-b082-19b83b12cf0f tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:12.508797 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7af1c0a2-faf4-460c-b082-19b83b12cf0f tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:12.580937 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7af1c0a2-faf4-460c-b082-19b83b12cf0f tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:12.589087 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7af1c0a2-faf4-460c-b082-19b83b12cf0f tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476" status: 200 len: 1217 microversion: 2.1 time: 0.095222 May 13 13:32:12.600108 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 517/1010] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:12 2022] GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476 => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:13.139279 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a89db3e5-755e-42e9-ac5a-ca6942b6ddde tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:13.140990 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a89db3e5-755e-42e9-ac5a-ca6942b6ddde tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:13.149128 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a89db3e5-755e-42e9-ac5a-ca6942b6ddde tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:13.149796 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a89db3e5-755e-42e9-ac5a-ca6942b6ddde tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:13.150998 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a89db3e5-755e-42e9-ac5a-ca6942b6ddde tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:13.156095 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a89db3e5-755e-42e9-ac5a-ca6942b6ddde tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:13.288101 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a89db3e5-755e-42e9-ac5a-ca6942b6ddde tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:13.296386 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a89db3e5-755e-42e9-ac5a-ca6942b6ddde tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f" status: 200 len: 1267 microversion: 2.1 time: 0.161591 May 13 13:32:13.296952 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 494/1011] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:13 2022] GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:13.607195 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b1e0b305-ae88-4470-bc47-fc9f697ef7b9 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:13.607825 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b1e0b305-ae88-4470-bc47-fc9f697ef7b9 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 08c6080c-b39d-43f6-af1f-8707f33d3476] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:13.614479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b1e0b305-ae88-4470-bc47-fc9f697ef7b9 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:13.614956 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b1e0b305-ae88-4470-bc47-fc9f697ef7b9 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:13.622039 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b1e0b305-ae88-4470-bc47-fc9f697ef7b9 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:13.622039 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b1e0b305-ae88-4470-bc47-fc9f697ef7b9 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:13.686723 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b1e0b305-ae88-4470-bc47-fc9f697ef7b9 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:13.694483 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b1e0b305-ae88-4470-bc47-fc9f697ef7b9 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476" status: 200 len: 1273 microversion: 2.1 time: 0.091581 May 13 13:32:13.695062 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 518/1012] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:13 2022] GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476 => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:14.313088 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-766d4f26-f0a5-4947-b40f-541fa2c306cb tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:14.313927 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-766d4f26-f0a5-4947-b40f-541fa2c306cb tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:14.320577 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-766d4f26-f0a5-4947-b40f-541fa2c306cb tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:14.320998 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-766d4f26-f0a5-4947-b40f-541fa2c306cb tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:14.321784 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-766d4f26-f0a5-4947-b40f-541fa2c306cb tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:14.322239 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-766d4f26-f0a5-4947-b40f-541fa2c306cb tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:14.472243 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-766d4f26-f0a5-4947-b40f-541fa2c306cb tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:14.485542 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-766d4f26-f0a5-4947-b40f-541fa2c306cb tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f" status: 200 len: 1267 microversion: 2.1 time: 0.176046 May 13 13:32:14.521396 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 495/1013] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:14 2022] GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:14.713171 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8db79cf3-cd57-4694-b5bd-3e5fd435f4b1 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:14.713785 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8db79cf3-cd57-4694-b5bd-3e5fd435f4b1 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 08c6080c-b39d-43f6-af1f-8707f33d3476] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:14.720918 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8db79cf3-cd57-4694-b5bd-3e5fd435f4b1 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:14.721363 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8db79cf3-cd57-4694-b5bd-3e5fd435f4b1 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:14.722138 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8db79cf3-cd57-4694-b5bd-3e5fd435f4b1 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:14.722600 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8db79cf3-cd57-4694-b5bd-3e5fd435f4b1 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:14.873543 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8db79cf3-cd57-4694-b5bd-3e5fd435f4b1 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:14.884371 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8db79cf3-cd57-4694-b5bd-3e5fd435f4b1 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476" status: 200 len: 1313 microversion: 2.1 time: 0.175115 May 13 13:32:14.884978 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 519/1014] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:14 2022] GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:15.490789 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-81d95edb-1b71-48f9-8f71-2b9df569545f req-dc72cde6-59ad-46c6-b279-d21b26ba4776 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08c6080c-b39d-43f6-af1f-8707f33d3476", "tag": "418c2f7a-fc8f-4633-9aa8-ff62bd364543"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:15.502930 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7879bd65-e67e-4d37-b01e-d0b4a65bd439 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:15.503515 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-81d95edb-1b71-48f9-8f71-2b9df569545f req-dc72cde6-59ad-46c6-b279-d21b26ba4776 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:15.503696 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7879bd65-e67e-4d37-b01e-d0b4a65bd439 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:15.504193 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-81d95edb-1b71-48f9-8f71-2b9df569545f req-dc72cde6-59ad-46c6-b279-d21b26ba4776 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:15.510741 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7879bd65-e67e-4d37-b01e-d0b4a65bd439 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:15.511018 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7879bd65-e67e-4d37-b01e-d0b4a65bd439 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:15.513245 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7879bd65-e67e-4d37-b01e-d0b4a65bd439 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:15.513689 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7879bd65-e67e-4d37-b01e-d0b4a65bd439 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:15.519970 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-81d95edb-1b71-48f9-8f71-2b9df569545f req-dc72cde6-59ad-46c6-b279-d21b26ba4776 service nova] Creating event network-changed:418c2f7a-fc8f-4633-9aa8-ff62bd364543 for instance 08c6080c-b39d-43f6-af1f-8707f33d3476 on hv-cinder-84163 May 13 13:32:15.524859 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-81d95edb-1b71-48f9-8f71-2b9df569545f req-dc72cde6-59ad-46c6-b279-d21b26ba4776 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038791 May 13 13:32:15.525657 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 496/1015] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:32:15.667419 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7879bd65-e67e-4d37-b01e-d0b4a65bd439 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:15.679318 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7879bd65-e67e-4d37-b01e-d0b4a65bd439 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f" status: 200 len: 1267 microversion: 2.1 time: 0.179859 May 13 13:32:15.680209 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 520/1016] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:15 2022] GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:15.764071 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3bad137e-0327-4c92-a469-b2cc65577d9f tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:15.765131 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3bad137e-0327-4c92-a469-b2cc65577d9f tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:15.772090 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3bad137e-0327-4c92-a469-b2cc65577d9f tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:15.772552 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3bad137e-0327-4c92-a469-b2cc65577d9f tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:15.773332 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3bad137e-0327-4c92-a469-b2cc65577d9f tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:15.773762 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3bad137e-0327-4c92-a469-b2cc65577d9f tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:15.907539 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f5c1b876-1a7d-458e-93b0-3a7b15762878 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:15.908146 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f5c1b876-1a7d-458e-93b0-3a7b15762878 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 08c6080c-b39d-43f6-af1f-8707f33d3476] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:15.914010 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f5c1b876-1a7d-458e-93b0-3a7b15762878 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:15.914485 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f5c1b876-1a7d-458e-93b0-3a7b15762878 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:15.915240 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f5c1b876-1a7d-458e-93b0-3a7b15762878 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:15.915672 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f5c1b876-1a7d-458e-93b0-3a7b15762878 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:16.073016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f5c1b876-1a7d-458e-93b0-3a7b15762878 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:16.081566 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f5c1b876-1a7d-458e-93b0-3a7b15762878 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476" status: 200 len: 1313 microversion: 2.1 time: 0.178615 May 13 13:32:16.082152 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 521/1017] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:15 2022] GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:16.095243 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3bad137e-0327-4c92-a469-b2cc65577d9f tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "POST /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e/action" status: 202 len: 0 microversion: 2.1 time: 0.335721 May 13 13:32:16.099274 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 497/1018] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 13 13:32:15 2022] POST /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:32:16.109221 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f73ad063-7106-4ea1-b698-913a41d8f280 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:16.110315 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f73ad063-7106-4ea1-b698-913a41d8f280 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:16.116800 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f73ad063-7106-4ea1-b698-913a41d8f280 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:16.117411 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f73ad063-7106-4ea1-b698-913a41d8f280 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:16.118337 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f73ad063-7106-4ea1-b698-913a41d8f280 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:16.118861 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f73ad063-7106-4ea1-b698-913a41d8f280 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:16.298917 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f73ad063-7106-4ea1-b698-913a41d8f280 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:16.307517 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f73ad063-7106-4ea1-b698-913a41d8f280 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1751 microversion: 2.1 time: 0.203102 May 13 13:32:16.308329 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 522/1019] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:16 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1751 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:16.697417 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7731fe2e-e403-4db1-8a3d-e74042d7f59e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:16.698114 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7731fe2e-e403-4db1-8a3d-e74042d7f59e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:16.704569 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7731fe2e-e403-4db1-8a3d-e74042d7f59e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:16.705020 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7731fe2e-e403-4db1-8a3d-e74042d7f59e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:16.705814 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7731fe2e-e403-4db1-8a3d-e74042d7f59e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:16.706282 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7731fe2e-e403-4db1-8a3d-e74042d7f59e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:16.870848 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7731fe2e-e403-4db1-8a3d-e74042d7f59e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:16.879255 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7731fe2e-e403-4db1-8a3d-e74042d7f59e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f" status: 200 len: 1267 microversion: 2.1 time: 0.186496 May 13 13:32:16.879822 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 498/1020] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:16 2022] GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:17.101524 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cc0bfa70-4cc5-46b3-8e34-41a2658aea73 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:17.102182 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-cc0bfa70-4cc5-46b3-8e34-41a2658aea73 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 08c6080c-b39d-43f6-af1f-8707f33d3476] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:17.112521 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cc0bfa70-4cc5-46b3-8e34-41a2658aea73 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:17.112975 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cc0bfa70-4cc5-46b3-8e34-41a2658aea73 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:17.113769 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cc0bfa70-4cc5-46b3-8e34-41a2658aea73 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:17.114228 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cc0bfa70-4cc5-46b3-8e34-41a2658aea73 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:17.265549 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-cc0bfa70-4cc5-46b3-8e34-41a2658aea73 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:17.274839 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-cc0bfa70-4cc5-46b3-8e34-41a2658aea73 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476" status: 200 len: 1313 microversion: 2.1 time: 0.178613 May 13 13:32:17.275428 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 523/1021] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:17 2022] GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:17.327275 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8228da9f-5f4c-404c-8645-21ee4dcf24c9 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:17.327895 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8228da9f-5f4c-404c-8645-21ee4dcf24c9 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:17.334126 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8228da9f-5f4c-404c-8645-21ee4dcf24c9 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:17.334746 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8228da9f-5f4c-404c-8645-21ee4dcf24c9 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:17.335788 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8228da9f-5f4c-404c-8645-21ee4dcf24c9 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:17.336366 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8228da9f-5f4c-404c-8645-21ee4dcf24c9 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:17.500744 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8228da9f-5f4c-404c-8645-21ee4dcf24c9 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:17.508774 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8228da9f-5f4c-404c-8645-21ee4dcf24c9 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1751 microversion: 2.1 time: 0.186415 May 13 13:32:17.509336 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 499/1022] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:17 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1751 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:17.896271 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6882f61c-3f0d-4c41-9c46-988438130ef9 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:17.896881 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6882f61c-3f0d-4c41-9c46-988438130ef9 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:17.903442 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6882f61c-3f0d-4c41-9c46-988438130ef9 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:17.903989 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6882f61c-3f0d-4c41-9c46-988438130ef9 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:17.904764 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6882f61c-3f0d-4c41-9c46-988438130ef9 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:17.905201 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6882f61c-3f0d-4c41-9c46-988438130ef9 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:18.048980 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6882f61c-3f0d-4c41-9c46-988438130ef9 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:18.056886 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6882f61c-3f0d-4c41-9c46-988438130ef9 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f" status: 200 len: 1267 microversion: 2.1 time: 0.164454 May 13 13:32:18.057467 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 524/1023] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:17 2022] GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:18.293980 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-77b8d283-7de1-4292-8467-b4fe845af59c tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:18.294740 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-77b8d283-7de1-4292-8467-b4fe845af59c tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 08c6080c-b39d-43f6-af1f-8707f33d3476] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:18.302149 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-77b8d283-7de1-4292-8467-b4fe845af59c tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:18.302619 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-77b8d283-7de1-4292-8467-b4fe845af59c tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:18.303395 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-77b8d283-7de1-4292-8467-b4fe845af59c tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:18.303859 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-77b8d283-7de1-4292-8467-b4fe845af59c tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:18.443750 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-77b8d283-7de1-4292-8467-b4fe845af59c tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:18.451370 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-77b8d283-7de1-4292-8467-b4fe845af59c tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476" status: 200 len: 1313 microversion: 2.1 time: 0.162305 May 13 13:32:18.452349 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 500/1024] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:18 2022] GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:18.527207 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-da2d0eb3-ad9e-48d0-8868-f3d6826b7e90 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:18.528541 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-da2d0eb3-ad9e-48d0-8868-f3d6826b7e90 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:18.535449 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-da2d0eb3-ad9e-48d0-8868-f3d6826b7e90 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:18.536164 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-da2d0eb3-ad9e-48d0-8868-f3d6826b7e90 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:18.537526 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-da2d0eb3-ad9e-48d0-8868-f3d6826b7e90 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:18.538322 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-da2d0eb3-ad9e-48d0-8868-f3d6826b7e90 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:18.709052 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-da2d0eb3-ad9e-48d0-8868-f3d6826b7e90 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:18.718740 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-da2d0eb3-ad9e-48d0-8868-f3d6826b7e90 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1756 microversion: 2.1 time: 0.195610 May 13 13:32:18.723708 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 525/1025] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:18 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1756 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:19.075608 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-71f42cfc-2fa1-4bd0-bbb2-907f0dcacab5 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:19.076314 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-71f42cfc-2fa1-4bd0-bbb2-907f0dcacab5 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:19.083021 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-71f42cfc-2fa1-4bd0-bbb2-907f0dcacab5 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:19.083473 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-71f42cfc-2fa1-4bd0-bbb2-907f0dcacab5 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:19.084254 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-71f42cfc-2fa1-4bd0-bbb2-907f0dcacab5 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:19.084688 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-71f42cfc-2fa1-4bd0-bbb2-907f0dcacab5 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:19.226910 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-71f42cfc-2fa1-4bd0-bbb2-907f0dcacab5 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:19.235443 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-71f42cfc-2fa1-4bd0-bbb2-907f0dcacab5 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f" status: 200 len: 1267 microversion: 2.1 time: 0.164585 May 13 13:32:19.236014 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 501/1026] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:19 2022] GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:19.471453 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2d0e2fd6-c554-407b-98ba-a330e71a25cc tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:19.472068 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2d0e2fd6-c554-407b-98ba-a330e71a25cc tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 08c6080c-b39d-43f6-af1f-8707f33d3476] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:19.478161 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2d0e2fd6-c554-407b-98ba-a330e71a25cc tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:19.478808 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2d0e2fd6-c554-407b-98ba-a330e71a25cc tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:19.479818 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2d0e2fd6-c554-407b-98ba-a330e71a25cc tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:19.480254 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2d0e2fd6-c554-407b-98ba-a330e71a25cc tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:19.710940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2d0e2fd6-c554-407b-98ba-a330e71a25cc tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:19.720192 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2d0e2fd6-c554-407b-98ba-a330e71a25cc tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476" status: 200 len: 1313 microversion: 2.1 time: 0.252739 May 13 13:32:19.720769 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 526/1027] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:19 2022] GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476 => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:19.737535 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-336a5ccf-7468-494e-a9a6-0afd78dcaa27 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:19.738130 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-336a5ccf-7468-494e-a9a6-0afd78dcaa27 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:19.744608 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-336a5ccf-7468-494e-a9a6-0afd78dcaa27 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:19.745059 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-336a5ccf-7468-494e-a9a6-0afd78dcaa27 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:19.745844 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-336a5ccf-7468-494e-a9a6-0afd78dcaa27 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:19.746301 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-336a5ccf-7468-494e-a9a6-0afd78dcaa27 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:19.994478 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-336a5ccf-7468-494e-a9a6-0afd78dcaa27 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:20.003157 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-336a5ccf-7468-494e-a9a6-0afd78dcaa27 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1756 microversion: 2.1 time: 0.269449 May 13 13:32:20.003733 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 502/1028] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:19 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1756 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:20.253206 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-31bac827-70a3-4660-9925-d9af8eb2f5fc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:20.253721 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-31bac827-70a3-4660-9925-d9af8eb2f5fc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:20.260040 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-31bac827-70a3-4660-9925-d9af8eb2f5fc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:20.260912 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-31bac827-70a3-4660-9925-d9af8eb2f5fc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:20.261264 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-31bac827-70a3-4660-9925-d9af8eb2f5fc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:20.261696 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-31bac827-70a3-4660-9925-d9af8eb2f5fc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:20.480084 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-31bac827-70a3-4660-9925-d9af8eb2f5fc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:20.491362 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-31bac827-70a3-4660-9925-d9af8eb2f5fc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f" status: 200 len: 1267 microversion: 2.1 time: 0.242455 May 13 13:32:20.492149 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 527/1029] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:20 2022] GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f => generated 1267 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:20.697541 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-81bf86f5-03c8-4f9a-88ca-58a82c5e92cc tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:20.698174 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-81bf86f5-03c8-4f9a-88ca-58a82c5e92cc tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:20.700019 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-e592d4a1-e656-4362-b9c4-311e1f9bcb42 req-34f55233-b771-4b02-a502-ebb39eec7e3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f4be22-416d-4465-9e39-d09271f63511", "tag": "7ceff24a-7ce2-4184-bc2c-ed2f493ac946"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:20.705625 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-81bf86f5-03c8-4f9a-88ca-58a82c5e92cc tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:20.706245 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-81bf86f5-03c8-4f9a-88ca-58a82c5e92cc tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:20.707313 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-81bf86f5-03c8-4f9a-88ca-58a82c5e92cc tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:20.707997 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-81bf86f5-03c8-4f9a-88ca-58a82c5e92cc tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:20.709015 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-e592d4a1-e656-4362-b9c4-311e1f9bcb42 req-34f55233-b771-4b02-a502-ebb39eec7e3d service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:20.709516 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-e592d4a1-e656-4362-b9c4-311e1f9bcb42 req-34f55233-b771-4b02-a502-ebb39eec7e3d service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:20.723597 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-e592d4a1-e656-4362-b9c4-311e1f9bcb42 req-34f55233-b771-4b02-a502-ebb39eec7e3d service nova] Creating event network-changed:7ceff24a-7ce2-4184-bc2c-ed2f493ac946 for instance 58f4be22-416d-4465-9e39-d09271f63511 on hv-cinder-84163 May 13 13:32:20.728876 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-e592d4a1-e656-4362-b9c4-311e1f9bcb42 req-34f55233-b771-4b02-a502-ebb39eec7e3d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032831 May 13 13:32:20.732000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 528/1030] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:32:20.738188 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-9840018f-2fb2-42d5-ad96-d738ffd0e810 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:20.739351 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-9840018f-2fb2-42d5-ad96-d738ffd0e810 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 08c6080c-b39d-43f6-af1f-8707f33d3476] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:20.746215 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9840018f-2fb2-42d5-ad96-d738ffd0e810 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:20.747000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9840018f-2fb2-42d5-ad96-d738ffd0e810 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:20.747967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9840018f-2fb2-42d5-ad96-d738ffd0e810 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:20.748577 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9840018f-2fb2-42d5-ad96-d738ffd0e810 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:20.753110 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-81bf86f5-03c8-4f9a-88ca-58a82c5e92cc tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Going to try to terminate instance {{(pid=117720) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:32:20.929911 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-9840018f-2fb2-42d5-ad96-d738ffd0e810 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:20.938870 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-9840018f-2fb2-42d5-ad96-d738ffd0e810 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476" status: 200 len: 1313 microversion: 2.1 time: 0.204881 May 13 13:32:20.939832 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 529/1031] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:20 2022] GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:20.988320 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-8de4269c-f741-4b21-a1b1-cccb9df025a9 req-a0928423-f036-44f9-9c32-81fe2b4857a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08c6080c-b39d-43f6-af1f-8707f33d3476", "name": "network-vif-plugged", "status": "completed", "tag": "418c2f7a-fc8f-4633-9aa8-ff62bd364543"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:20.999886 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-8de4269c-f741-4b21-a1b1-cccb9df025a9 req-a0928423-f036-44f9-9c32-81fe2b4857a2 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:21.000713 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-8de4269c-f741-4b21-a1b1-cccb9df025a9 req-a0928423-f036-44f9-9c32-81fe2b4857a2 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:21.014538 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-8de4269c-f741-4b21-a1b1-cccb9df025a9 req-a0928423-f036-44f9-9c32-81fe2b4857a2 service nova] Creating event network-vif-plugged:418c2f7a-fc8f-4633-9aa8-ff62bd364543 for instance 08c6080c-b39d-43f6-af1f-8707f33d3476 on hv-cinder-84163 May 13 13:32:21.020258 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-8de4269c-f741-4b21-a1b1-cccb9df025a9 req-a0928423-f036-44f9-9c32-81fe2b4857a2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042210 May 13 13:32:21.021415 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 530/1032] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:32:21.027110 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-54402685-5633-4030-b624-344c29b38747 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:21.029348 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-54402685-5633-4030-b624-344c29b38747 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:21.038627 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-54402685-5633-4030-b624-344c29b38747 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:21.039943 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-54402685-5633-4030-b624-344c29b38747 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:21.041338 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-54402685-5633-4030-b624-344c29b38747 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:21.041951 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-54402685-5633-4030-b624-344c29b38747 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:21.117173 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-81bf86f5-03c8-4f9a-88ca-58a82c5e92cc tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "DELETE /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 204 len: 0 microversion: 2.1 time: 0.423707 May 13 13:32:21.117870 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 503/1033] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:32:20 2022] DELETE /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:32:21.128212 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8e9f7af6-13a1-4a2b-b506-5d87cf7b4a48 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:21.138512 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8e9f7af6-13a1-4a2b-b506-5d87cf7b4a48 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:21.141972 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8e9f7af6-13a1-4a2b-b506-5d87cf7b4a48 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:21.142680 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8e9f7af6-13a1-4a2b-b506-5d87cf7b4a48 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:21.143707 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8e9f7af6-13a1-4a2b-b506-5d87cf7b4a48 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:21.144500 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8e9f7af6-13a1-4a2b-b506-5d87cf7b4a48 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:21.303702 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-54402685-5633-4030-b624-344c29b38747 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:21.311698 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-54402685-5633-4030-b624-344c29b38747 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1756 microversion: 2.1 time: 0.288910 May 13 13:32:21.312347 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 531/1034] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:21 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1756 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:21.345430 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8e9f7af6-13a1-4a2b-b506-5d87cf7b4a48 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:21.352688 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8e9f7af6-13a1-4a2b-b506-5d87cf7b4a48 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1569 microversion: 2.1 time: 0.229030 May 13 13:32:21.353248 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 504/1035] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:21 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1569 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:21.509220 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d9210f19-168a-4802-90c9-0444562fefb2 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:21.510256 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d9210f19-168a-4802-90c9-0444562fefb2 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:21.518333 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d9210f19-168a-4802-90c9-0444562fefb2 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:21.518882 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d9210f19-168a-4802-90c9-0444562fefb2 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:21.519789 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d9210f19-168a-4802-90c9-0444562fefb2 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:21.520293 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d9210f19-168a-4802-90c9-0444562fefb2 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:21.663105 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d9210f19-168a-4802-90c9-0444562fefb2 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:21.670866 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d9210f19-168a-4802-90c9-0444562fefb2 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f" status: 200 len: 1267 microversion: 2.1 time: 0.165796 May 13 13:32:21.671421 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 532/1036] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:21 2022] GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:21.963001 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-52ff6b2a-96c7-4389-abb2-1294fe095b2c tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:21.963617 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-52ff6b2a-96c7-4389-abb2-1294fe095b2c tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 08c6080c-b39d-43f6-af1f-8707f33d3476] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:21.970838 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-52ff6b2a-96c7-4389-abb2-1294fe095b2c tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:21.971285 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-52ff6b2a-96c7-4389-abb2-1294fe095b2c tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:21.972073 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-52ff6b2a-96c7-4389-abb2-1294fe095b2c tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:21.972509 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-52ff6b2a-96c7-4389-abb2-1294fe095b2c tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:22.128286 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-52ff6b2a-96c7-4389-abb2-1294fe095b2c tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:22.136022 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-52ff6b2a-96c7-4389-abb2-1294fe095b2c tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476" status: 200 len: 1313 microversion: 2.1 time: 0.176770 May 13 13:32:22.136605 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 505/1037] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:21 2022] GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:22.331617 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a27dcf4c-505a-4c38-90c7-e432124579f2 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:22.332236 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a27dcf4c-505a-4c38-90c7-e432124579f2 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:22.338919 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a27dcf4c-505a-4c38-90c7-e432124579f2 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:22.339387 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a27dcf4c-505a-4c38-90c7-e432124579f2 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:22.341135 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a27dcf4c-505a-4c38-90c7-e432124579f2 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:22.341577 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a27dcf4c-505a-4c38-90c7-e432124579f2 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:22.369867 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f7f3a409-0803-4b69-bec0-2b4b538b94de tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:22.370778 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f7f3a409-0803-4b69-bec0-2b4b538b94de tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:22.387339 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f7f3a409-0803-4b69-bec0-2b4b538b94de tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:22.387856 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f7f3a409-0803-4b69-bec0-2b4b538b94de tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:22.388775 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f7f3a409-0803-4b69-bec0-2b4b538b94de tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:22.389209 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f7f3a409-0803-4b69-bec0-2b4b538b94de tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:22.569516 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a27dcf4c-505a-4c38-90c7-e432124579f2 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:22.577923 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a27dcf4c-505a-4c38-90c7-e432124579f2 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1756 microversion: 2.1 time: 0.252048 May 13 13:32:22.578733 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 533/1038] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:22 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1756 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:22.587624 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f7f3a409-0803-4b69-bec0-2b4b538b94de tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:22.596267 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f7f3a409-0803-4b69-bec0-2b4b538b94de tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1569 microversion: 2.1 time: 0.230189 May 13 13:32:22.596822 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 506/1039] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:22 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1569 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:22.688321 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-016b3d2f-7ad1-4939-a02c-69430d458225 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:22.694643 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-016b3d2f-7ad1-4939-a02c-69430d458225 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:22.694937 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-016b3d2f-7ad1-4939-a02c-69430d458225 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:22.695392 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-016b3d2f-7ad1-4939-a02c-69430d458225 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:22.696170 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-016b3d2f-7ad1-4939-a02c-69430d458225 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:22.696599 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-016b3d2f-7ad1-4939-a02c-69430d458225 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:22.853509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-016b3d2f-7ad1-4939-a02c-69430d458225 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:22.861422 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-016b3d2f-7ad1-4939-a02c-69430d458225 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f" status: 200 len: 1267 microversion: 2.1 time: 0.177743 May 13 13:32:22.862686 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 534/1040] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:22 2022] GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:23.048045 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-f6ba9c37-8960-4229-a8cb-0e79be62a33d req-8b623489-1fd2-4a4f-b851-e902075c875c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4c37c70-bc64-4dc6-92eb-41a9df5a319f", "name": "network-vif-plugged", "status": "completed", "tag": "e4cad75c-2de5-45aa-88b3-e937529cf2a8"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:23.056656 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-f6ba9c37-8960-4229-a8cb-0e79be62a33d req-8b623489-1fd2-4a4f-b851-e902075c875c service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:23.057097 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-f6ba9c37-8960-4229-a8cb-0e79be62a33d req-8b623489-1fd2-4a4f-b851-e902075c875c service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:23.069721 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-f6ba9c37-8960-4229-a8cb-0e79be62a33d req-8b623489-1fd2-4a4f-b851-e902075c875c service nova] Creating event network-vif-plugged:e4cad75c-2de5-45aa-88b3-e937529cf2a8 for instance a4c37c70-bc64-4dc6-92eb-41a9df5a319f on hv-cinder-84163 May 13 13:32:23.075593 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-f6ba9c37-8960-4229-a8cb-0e79be62a33d req-8b623489-1fd2-4a4f-b851-e902075c875c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030213 May 13 13:32:23.076402 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 507/1041] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:32:23.152937 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a8b7f42e-1f1c-4310-9185-645fd46f3814 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:23.153680 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a8b7f42e-1f1c-4310-9185-645fd46f3814 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 08c6080c-b39d-43f6-af1f-8707f33d3476] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:23.159749 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a8b7f42e-1f1c-4310-9185-645fd46f3814 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:23.160241 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a8b7f42e-1f1c-4310-9185-645fd46f3814 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:23.160954 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a8b7f42e-1f1c-4310-9185-645fd46f3814 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:23.161391 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a8b7f42e-1f1c-4310-9185-645fd46f3814 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:23.318996 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a8b7f42e-1f1c-4310-9185-645fd46f3814 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:23.325698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-db19bfab-3434-4c44-8203-77c0e237af78 req-288d356a-f68f-4daa-a767-ed7c577474f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f4be22-416d-4465-9e39-d09271f63511", "name": "network-vif-deleted", "tag": "7ceff24a-7ce2-4184-bc2c-ed2f493ac946"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:23.328563 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a8b7f42e-1f1c-4310-9185-645fd46f3814 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476" status: 200 len: 1313 microversion: 2.1 time: 0.179498 May 13 13:32:23.335329 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-db19bfab-3434-4c44-8203-77c0e237af78 req-288d356a-f68f-4daa-a767-ed7c577474f8 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:23.335768 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-db19bfab-3434-4c44-8203-77c0e237af78 req-288d356a-f68f-4daa-a767-ed7c577474f8 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:23.338049 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 535/1042] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:23 2022] GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:23.350700 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-db19bfab-3434-4c44-8203-77c0e237af78 req-288d356a-f68f-4daa-a767-ed7c577474f8 service nova] Creating event network-vif-deleted:7ceff24a-7ce2-4184-bc2c-ed2f493ac946 for instance 58f4be22-416d-4465-9e39-d09271f63511 on hv-cinder-84163 May 13 13:32:23.356315 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-db19bfab-3434-4c44-8203-77c0e237af78 req-288d356a-f68f-4daa-a767-ed7c577474f8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034138 May 13 13:32:23.357029 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 508/1043] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:32:23.596702 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d3430214-e81a-4650-8117-ca0ff28a8516 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:23.597317 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d3430214-e81a-4650-8117-ca0ff28a8516 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:23.604720 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d3430214-e81a-4650-8117-ca0ff28a8516 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:23.605168 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d3430214-e81a-4650-8117-ca0ff28a8516 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:23.606886 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d3430214-e81a-4650-8117-ca0ff28a8516 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:23.607143 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d3430214-e81a-4650-8117-ca0ff28a8516 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:23.614690 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-fd735642-e09e-41b0-96f7-30c5cd1e8c76 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:23.615385 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-fd735642-e09e-41b0-96f7-30c5cd1e8c76 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:23.631183 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd735642-e09e-41b0-96f7-30c5cd1e8c76 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:23.632198 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd735642-e09e-41b0-96f7-30c5cd1e8c76 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:23.633241 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd735642-e09e-41b0-96f7-30c5cd1e8c76 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:23.633843 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd735642-e09e-41b0-96f7-30c5cd1e8c76 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:23.725167 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fd735642-e09e-41b0-96f7-30c5cd1e8c76 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:23.734985 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-fd735642-e09e-41b0-96f7-30c5cd1e8c76 tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1219 microversion: 2.1 time: 0.124943 May 13 13:32:23.735576 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 509/1044] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:23 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1219 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:23.807384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d3430214-e81a-4650-8117-ca0ff28a8516 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:23.818350 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d3430214-e81a-4650-8117-ca0ff28a8516 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1756 microversion: 2.1 time: 0.225920 May 13 13:32:23.818935 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 536/1045] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:23 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1756 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:23.878507 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7bd08c46-1883-464e-9cf5-bacc63af248a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:23.879017 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7bd08c46-1883-464e-9cf5-bacc63af248a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:23.885033 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7bd08c46-1883-464e-9cf5-bacc63af248a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:23.885483 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7bd08c46-1883-464e-9cf5-bacc63af248a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:23.886269 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7bd08c46-1883-464e-9cf5-bacc63af248a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:23.886717 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7bd08c46-1883-464e-9cf5-bacc63af248a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:24.037160 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7bd08c46-1883-464e-9cf5-bacc63af248a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:24.045158 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7bd08c46-1883-464e-9cf5-bacc63af248a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f" status: 200 len: 1267 microversion: 2.1 time: 0.170618 May 13 13:32:24.045796 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 510/1046] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:23 2022] GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:24.346350 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-9543ad98-c3d3-43b0-bb4a-39dd24bd6250 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:24.346975 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-9543ad98-c3d3-43b0-bb4a-39dd24bd6250 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 08c6080c-b39d-43f6-af1f-8707f33d3476] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:24.352826 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9543ad98-c3d3-43b0-bb4a-39dd24bd6250 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:24.353270 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9543ad98-c3d3-43b0-bb4a-39dd24bd6250 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:24.354085 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9543ad98-c3d3-43b0-bb4a-39dd24bd6250 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:24.354534 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9543ad98-c3d3-43b0-bb4a-39dd24bd6250 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:24.497106 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-9543ad98-c3d3-43b0-bb4a-39dd24bd6250 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:24.505711 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-9543ad98-c3d3-43b0-bb4a-39dd24bd6250 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476" status: 200 len: 1496 microversion: 2.1 time: 0.163659 May 13 13:32:24.506311 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 537/1047] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:24 2022] GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476 => generated 1496 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:24.753555 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c22fc709-f775-4ebf-a608-c330e457905c tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:24.754138 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c22fc709-f775-4ebf-a608-c330e457905c tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:24.761054 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c22fc709-f775-4ebf-a608-c330e457905c tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:24.761485 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c22fc709-f775-4ebf-a608-c330e457905c tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:24.762965 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c22fc709-f775-4ebf-a608-c330e457905c tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:24.763396 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c22fc709-f775-4ebf-a608-c330e457905c tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:24.796486 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c22fc709-f775-4ebf-a608-c330e457905c tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:24.796939 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c22fc709-f775-4ebf-a608-c330e457905c tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:24.797363 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-c22fc709-f775-4ebf-a608-c330e457905c tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lazy-loading 'fault' on Instance uuid 58f4be22-416d-4465-9e39-d09271f63511 {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:32:24.835892 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b259e12d-723f-4d35-ace9-d6c1d8d01f8e tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:24.836502 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b259e12d-723f-4d35-ace9-d6c1d8d01f8e tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:24.841373 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c22fc709-f775-4ebf-a608-c330e457905c tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e135e636ed64741a890205b367efd40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286d953594e4d539ca45c8a98bd435c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:24.843177 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b259e12d-723f-4d35-ace9-d6c1d8d01f8e tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:24.843570 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b259e12d-723f-4d35-ace9-d6c1d8d01f8e tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:24.844587 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b259e12d-723f-4d35-ace9-d6c1d8d01f8e tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:24.845016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b259e12d-723f-4d35-ace9-d6c1d8d01f8e tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:24.849436 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c22fc709-f775-4ebf-a608-c330e457905c tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 200 len: 1224 microversion: 2.1 time: 0.100463 May 13 13:32:24.850246 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 511/1048] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:24 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:25.004848 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b259e12d-723f-4d35-ace9-d6c1d8d01f8e tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:25.013374 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b259e12d-723f-4d35-ace9-d6c1d8d01f8e tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1756 microversion: 2.1 time: 0.181361 May 13 13:32:25.014816 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 538/1049] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:24 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:25.062000 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b1fdd610-5a34-4e71-be7e-f41933185715 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:25.062653 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b1fdd610-5a34-4e71-be7e-f41933185715 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:25.068553 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b1fdd610-5a34-4e71-be7e-f41933185715 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:25.074148 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b1fdd610-5a34-4e71-be7e-f41933185715 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:25.074148 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b1fdd610-5a34-4e71-be7e-f41933185715 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:25.074148 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b1fdd610-5a34-4e71-be7e-f41933185715 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:25.217981 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b1fdd610-5a34-4e71-be7e-f41933185715 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:25.224476 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b1fdd610-5a34-4e71-be7e-f41933185715 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f" status: 200 len: 1267 microversion: 2.1 time: 0.167227 May 13 13:32:25.225147 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 512/1050] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:25 2022] GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:25.385875 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-29b2dbdf-89c3-4295-bc4e-ce4ecdceda9f tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:25.393246 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-29b2dbdf-89c3-4295-bc4e-ce4ecdceda9f tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 08c6080c-b39d-43f6-af1f-8707f33d3476] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:25.393246 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-29b2dbdf-89c3-4295-bc4e-ce4ecdceda9f tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:25.393580 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-29b2dbdf-89c3-4295-bc4e-ce4ecdceda9f tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:25.394324 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-29b2dbdf-89c3-4295-bc4e-ce4ecdceda9f tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:25.394760 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-29b2dbdf-89c3-4295-bc4e-ce4ecdceda9f tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:25.421704 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-29b2dbdf-89c3-4295-bc4e-ce4ecdceda9f tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 08c6080c-b39d-43f6-af1f-8707f33d3476] Going to try to terminate instance {{(pid=117721) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:32:25.843155 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-29b2dbdf-89c3-4295-bc4e-ce4ecdceda9f tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "DELETE /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476" status: 204 len: 0 microversion: 2.1 time: 0.460928 May 13 13:32:25.843754 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 539/1051] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:32:25 2022] DELETE /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:32:25.852595 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a85f1a30-71dd-487a-afb9-0adcf23bf02c tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:25.853361 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a85f1a30-71dd-487a-afb9-0adcf23bf02c tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 08c6080c-b39d-43f6-af1f-8707f33d3476] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:25.860125 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a85f1a30-71dd-487a-afb9-0adcf23bf02c tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:25.860572 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a85f1a30-71dd-487a-afb9-0adcf23bf02c tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:25.861347 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a85f1a30-71dd-487a-afb9-0adcf23bf02c tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:25.861777 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a85f1a30-71dd-487a-afb9-0adcf23bf02c tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:25.983803 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7bec443c-2953-4fc1-8eaf-edf337b867be tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:25.984635 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7bec443c-2953-4fc1-8eaf-edf337b867be tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] [instance: 58f4be22-416d-4465-9e39-d09271f63511] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:25.991786 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7bec443c-2953-4fc1-8eaf-edf337b867be tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:25.992470 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7bec443c-2953-4fc1-8eaf-edf337b867be tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:25.993410 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7bec443c-2953-4fc1-8eaf-edf337b867be tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:25.993947 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7bec443c-2953-4fc1-8eaf-edf337b867be tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:26.000686 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a85f1a30-71dd-487a-afb9-0adcf23bf02c tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:26.008308 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a85f1a30-71dd-487a-afb9-0adcf23bf02c tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476" status: 200 len: 1502 microversion: 2.1 time: 0.159761 May 13 13:32:26.008892 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 513/1052] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:25 2022] GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:26.009134 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-7bec443c-2953-4fc1-8eaf-edf337b867be tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] HTTP exception thrown: Instance 58f4be22-416d-4465-9e39-d09271f63511 could not be found. May 13 13:32:26.010814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7bec443c-2953-4fc1-8eaf-edf337b867be tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Request method failure captured: May 13 13:32:26.010814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 HTTP/1.1 May 13 13:32:26.010814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:32:26.010814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:32:26.010814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:32:26.010814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:32:26.010814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:32:26.010814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:32:26.010814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:32:26.010814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:32:26.010814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABifly2UkS7SkJ3ZLjg-1X6DmvMEGe428Hw6sv4cDVdMBMqBXjcqzcFR6Jj1AAIStkWbuta_pBGiVO4yCTRAMuqQKCvK_fGJETo_9ts1RBUH5uG55Dubr9o4gpz84fbraI4glKrk_HX2alrBu9OurOH5jHrKG6Oa7iiIfb5h-WhuYBvQ6o May 13 13:32:26.010814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:32:26.010814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:32:26.010814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:32:26.010814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:32:26.010814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:32:26.010814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:32:26.010814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: 8286d953594e4d539ca45c8a98bd435c May 13 13:32:26.010814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-TestShelveInstance-430027051 May 13 13:32:26.010814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:32:26.010814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:32:26.013000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8286d953594e4d539ca45c8a98bd435c", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8286d953594e4d539ca45c8a98bd435c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8286d953594e4d539ca45c8a98bd435c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8286d953594e4d539ca45c8a98bd435c"}]}] May 13 13:32:26.013000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-TestShelveInstance-430027051 May 13 13:32:26.013000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 8286d953594e4d539ca45c8a98bd435c May 13 13:32:26.013000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-TestShelveInstance-430027051 May 13 13:32:26.013000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-TestShelveInstance-430027051-project May 13 13:32:26.013000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:32:26.013000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:32:26.013000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: 8e135e636ed64741a890205b367efd40 May 13 13:32:26.013000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-TestShelveInstance-430027051-project May 13 13:32:26.013000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: > May 13 13:32:26.013000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Instance 58f4be22-416d-4465-9e39-d09271f63511 could not be found. May 13 13:32:26.013000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': '58f4be22-416d-4465-9e39-d09271f63511'} May 13 13:32:26.013991 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:32:26.013991 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:26.013991 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:32:26.013991 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:32:26.013991 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:32:26.013991 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:32:26.013991 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:32:26.013991 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:32:26.013991 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:32:26.013991 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:32:26.013991 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f4be22-416d-4465-9e39-d09271f63511 could not be found. May 13 13:32:26.013991 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:32:26.013991 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:26.013991 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:32:26.013991 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:26.013991 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:26.013991 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:26.013991 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:32:26.013991 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:32:26.013991 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:32:26.016520 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:32:26.016520 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:32:26.016520 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:32:26.016520 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:32:26.016520 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:32:26.016520 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:32:26.016520 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:32:26.016520 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f4be22-416d-4465-9e39-d09271f63511 could not be found. May 13 13:32:26.016520 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:32:26.016520 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:26.016520 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:32:26.016520 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:26.016520 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:26.016520 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:26.016520 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:32:26.016520 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:32:26.016520 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f4be22-416d-4465-9e39-d09271f63511 could not be found. May 13 13:32:26.016520 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:32:26.018121 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7bec443c-2953-4fc1-8eaf-edf337b867be tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Returning 404 to user: Instance 58f4be22-416d-4465-9e39-d09271f63511 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:32:26.018121 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7bec443c-2953-4fc1-8eaf-edf337b867be tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511" status: 404 len: 111 microversion: 2.1 time: 0.148373 May 13 13:32:26.018121 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 540/1053] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:25 2022] GET /compute/v2.1/servers/58f4be22-416d-4465-9e39-d09271f63511 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 13:32:26.032111 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-60b1447f-4cd5-4242-9650-e1db50ba8443 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:26.032965 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-60b1447f-4cd5-4242-9650-e1db50ba8443 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:26.039023 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-60b1447f-4cd5-4242-9650-e1db50ba8443 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:26.039472 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-60b1447f-4cd5-4242-9650-e1db50ba8443 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:26.040255 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-60b1447f-4cd5-4242-9650-e1db50ba8443 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:26.040687 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-60b1447f-4cd5-4242-9650-e1db50ba8443 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:26.242702 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6e7e1178-58a6-4d1d-a844-9a7db0ff855a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:26.243398 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6e7e1178-58a6-4d1d-a844-9a7db0ff855a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:26.243589 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-60b1447f-4cd5-4242-9650-e1db50ba8443 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:26.251637 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6e7e1178-58a6-4d1d-a844-9a7db0ff855a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:26.252393 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6e7e1178-58a6-4d1d-a844-9a7db0ff855a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:26.252879 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-60b1447f-4cd5-4242-9650-e1db50ba8443 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1756 microversion: 2.1 time: 0.225183 May 13 13:32:26.253306 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6e7e1178-58a6-4d1d-a844-9a7db0ff855a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:26.253700 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 514/1054] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:26 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1756 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:26.254323 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6e7e1178-58a6-4d1d-a844-9a7db0ff855a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:26.353279 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-da5f17ea-384a-4df0-987a-4b2c919920ac tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] Calling method '.version_select at 0x7fb0840f1ca0>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:26.406437 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6e7e1178-58a6-4d1d-a844-9a7db0ff855a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:26.414178 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6e7e1178-58a6-4d1d-a844-9a7db0ff855a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f" status: 200 len: 1455 microversion: 2.1 time: 0.175616 May 13 13:32:26.414778 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 541/1055] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:26 2022] GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f => generated 1455 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:26.430918 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-da5f17ea-384a-4df0-987a-4b2c919920ac tempest-TestShelveInstance-430027051 tempest-TestShelveInstance-430027051-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1509969682" status: 202 len: 0 microversion: 2.1 time: 0.081475 May 13 13:32:26.431596 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-aef0fbb7-f3f4-4c29-80b5-c2d7c9609353 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:26.432406 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-aef0fbb7-f3f4-4c29-80b5-c2d7c9609353 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:26.436510 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 515/1056] 10.222.0.13 () {58 vars in 1253 bytes} [Fri May 13 13:32:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1509969682 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:32:26.451818 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aef0fbb7-f3f4-4c29-80b5-c2d7c9609353 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:26.452717 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aef0fbb7-f3f4-4c29-80b5-c2d7c9609353 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:26.454229 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aef0fbb7-f3f4-4c29-80b5-c2d7c9609353 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:26.454229 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aef0fbb7-f3f4-4c29-80b5-c2d7c9609353 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:26.679819 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-aef0fbb7-f3f4-4c29-80b5-c2d7c9609353 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:26.689228 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-aef0fbb7-f3f4-4c29-80b5-c2d7c9609353 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f" status: 200 len: 1455 microversion: 2.1 time: 0.261389 May 13 13:32:26.689805 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 542/1057] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:26 2022] GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f => generated 1455 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:27.029053 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a126bc6d-18fc-4b88-8237-19375d44d029 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:27.029989 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a126bc6d-18fc-4b88-8237-19375d44d029 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 08c6080c-b39d-43f6-af1f-8707f33d3476] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:27.038376 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a126bc6d-18fc-4b88-8237-19375d44d029 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:27.039123 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a126bc6d-18fc-4b88-8237-19375d44d029 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:27.039919 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a126bc6d-18fc-4b88-8237-19375d44d029 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:27.040349 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a126bc6d-18fc-4b88-8237-19375d44d029 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:27.271709 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4dbd8184-f622-4557-9bc5-57155fdaaf63 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:27.272400 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4dbd8184-f622-4557-9bc5-57155fdaaf63 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:27.280615 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4dbd8184-f622-4557-9bc5-57155fdaaf63 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:27.281157 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4dbd8184-f622-4557-9bc5-57155fdaaf63 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:27.282020 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4dbd8184-f622-4557-9bc5-57155fdaaf63 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:27.282629 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4dbd8184-f622-4557-9bc5-57155fdaaf63 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:27.604490 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a126bc6d-18fc-4b88-8237-19375d44d029 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:27.614777 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a126bc6d-18fc-4b88-8237-19375d44d029 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476" status: 200 len: 1502 microversion: 2.1 time: 0.590266 May 13 13:32:27.615615 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 516/1058] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:27 2022] GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476 => generated 1502 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:27.699845 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4dbd8184-f622-4557-9bc5-57155fdaaf63 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:27.708088 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4dbd8184-f622-4557-9bc5-57155fdaaf63 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1756 microversion: 2.1 time: 0.440653 May 13 13:32:27.708822 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 543/1059] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:27 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1756 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:28.500781 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-edba1060-a63b-4416-b95c-6f02c32ea5a2 req-7444f203-8a86-4874-95f5-2c3eea8e3181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08c6080c-b39d-43f6-af1f-8707f33d3476", "name": "network-vif-deleted", "tag": "418c2f7a-fc8f-4633-9aa8-ff62bd364543"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:28.509147 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-edba1060-a63b-4416-b95c-6f02c32ea5a2 req-7444f203-8a86-4874-95f5-2c3eea8e3181 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:28.509599 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-edba1060-a63b-4416-b95c-6f02c32ea5a2 req-7444f203-8a86-4874-95f5-2c3eea8e3181 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:28.522244 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-edba1060-a63b-4416-b95c-6f02c32ea5a2 req-7444f203-8a86-4874-95f5-2c3eea8e3181 service nova] Creating event network-vif-deleted:418c2f7a-fc8f-4633-9aa8-ff62bd364543 for instance 08c6080c-b39d-43f6-af1f-8707f33d3476 on hv-cinder-84163 May 13 13:32:28.528492 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-edba1060-a63b-4416-b95c-6f02c32ea5a2 req-7444f203-8a86-4874-95f5-2c3eea8e3181 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031247 May 13 13:32:28.529396 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 517/1060] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:32:28.636008 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-87c049f6-60da-4dfc-9042-922d19da81de tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:28.637906 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-87c049f6-60da-4dfc-9042-922d19da81de tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 08c6080c-b39d-43f6-af1f-8707f33d3476] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:28.649196 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-87c049f6-60da-4dfc-9042-922d19da81de tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:28.649532 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-87c049f6-60da-4dfc-9042-922d19da81de tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:28.650347 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-87c049f6-60da-4dfc-9042-922d19da81de tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:28.650852 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-87c049f6-60da-4dfc-9042-922d19da81de tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:28.727198 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8625c2c3-a36c-4375-ba9d-8025230c7fb2 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:28.727920 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8625c2c3-a36c-4375-ba9d-8025230c7fb2 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:28.739778 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8625c2c3-a36c-4375-ba9d-8025230c7fb2 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:28.740234 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8625c2c3-a36c-4375-ba9d-8025230c7fb2 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:28.741038 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8625c2c3-a36c-4375-ba9d-8025230c7fb2 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:28.741483 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8625c2c3-a36c-4375-ba9d-8025230c7fb2 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:28.770427 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-87c049f6-60da-4dfc-9042-922d19da81de tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2440a67e143544b48850e3e9ab624a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2dfc119af794405abce655b77cb8784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:28.782991 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-87c049f6-60da-4dfc-9042-922d19da81de tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476" status: 200 len: 1460 microversion: 2.1 time: 0.152268 May 13 13:32:28.799005 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 544/1061] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:28 2022] GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476 => generated 1460 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:28.931705 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8625c2c3-a36c-4375-ba9d-8025230c7fb2 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:28.940934 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8625c2c3-a36c-4375-ba9d-8025230c7fb2 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1756 microversion: 2.1 time: 0.218676 May 13 13:32:28.952223 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 518/1062] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:28 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1756 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:29.800018 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6fc64bf3-0be1-4305-bee1-b3b9be70c780 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:29.801795 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6fc64bf3-0be1-4305-bee1-b3b9be70c780 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] [instance: 08c6080c-b39d-43f6-af1f-8707f33d3476] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:29.809357 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6fc64bf3-0be1-4305-bee1-b3b9be70c780 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:29.818744 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6fc64bf3-0be1-4305-bee1-b3b9be70c780 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:29.818744 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6fc64bf3-0be1-4305-bee1-b3b9be70c780 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:29.818744 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6fc64bf3-0be1-4305-bee1-b3b9be70c780 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:29.829250 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-6fc64bf3-0be1-4305-bee1-b3b9be70c780 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] HTTP exception thrown: Instance 08c6080c-b39d-43f6-af1f-8707f33d3476 could not be found. May 13 13:32:29.832194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6fc64bf3-0be1-4305-bee1-b3b9be70c780 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Request method failure captured: May 13 13:32:29.832194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476 HTTP/1.1 May 13 13:32:29.832194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:32:29.832194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:32:29.832194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:32:29.832194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:32:29.832194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:32:29.832194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:32:29.832194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:32:29.832194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:32:29.832194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABifl3GC-wVtzHBq8DQvi1XyBVjSqW5geH8nebqDvfSn0rIh3K3rSdLOg2VprhzIeHZfQHW-jxDz5vehcEEZ6dbx3BsM3V7qSfXgdd_BqSw-YOLn9-vSd5bIiOr-vS4J6Z3ufGOHkoclVrFksz6XLTiTKTT7a4EGnHW5ZHBgPNrv0Nzecg May 13 13:32:29.832194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:32:29.832194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:32:29.832194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:32:29.832194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:32:29.832194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:32:29.832194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:32:29.832194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: a2dfc119af794405abce655b77cb8784 May 13 13:32:29.832194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-VolumesActionsTest-1345630934 May 13 13:32:29.832194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:32:29.832194 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:32:29.833796 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a2dfc119af794405abce655b77cb8784", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a2dfc119af794405abce655b77cb8784"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a2dfc119af794405abce655b77cb8784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a2dfc119af794405abce655b77cb8784"}]}] May 13 13:32:29.833796 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-VolumesActionsTest-1345630934 May 13 13:32:29.833796 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: a2dfc119af794405abce655b77cb8784 May 13 13:32:29.833796 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-VolumesActionsTest-1345630934 May 13 13:32:29.833796 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-VolumesActionsTest-1345630934-project May 13 13:32:29.833796 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:32:29.833796 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:32:29.833796 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: 2440a67e143544b48850e3e9ab624a8b May 13 13:32:29.833796 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-VolumesActionsTest-1345630934-project May 13 13:32:29.833796 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: > May 13 13:32:29.833796 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Instance 08c6080c-b39d-43f6-af1f-8707f33d3476 could not be found. May 13 13:32:29.833796 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': '08c6080c-b39d-43f6-af1f-8707f33d3476'} May 13 13:32:29.835000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:32:29.835000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:29.835000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:32:29.835000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:32:29.835000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:32:29.835000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:32:29.835000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:32:29.835000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:32:29.835000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:32:29.835000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:32:29.835000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08c6080c-b39d-43f6-af1f-8707f33d3476 could not be found. May 13 13:32:29.835000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:32:29.835000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:29.835000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:32:29.835000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:29.835000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:29.835000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:29.835000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:32:29.835000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:32:29.835000 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:32:29.836502 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:32:29.836502 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:32:29.836502 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:32:29.836502 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:32:29.836502 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:32:29.836502 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:32:29.836502 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:32:29.836502 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08c6080c-b39d-43f6-af1f-8707f33d3476 could not be found. May 13 13:32:29.836502 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:32:29.836502 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:29.836502 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:32:29.836502 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:29.836502 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:29.836502 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:29.836502 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:32:29.836502 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:32:29.836502 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08c6080c-b39d-43f6-af1f-8707f33d3476 could not be found. May 13 13:32:29.836502 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:32:29.837821 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6fc64bf3-0be1-4305-bee1-b3b9be70c780 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] Returning 404 to user: Instance 08c6080c-b39d-43f6-af1f-8707f33d3476 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:32:29.837821 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6fc64bf3-0be1-4305-bee1-b3b9be70c780 tempest-VolumesActionsTest-1345630934 tempest-VolumesActionsTest-1345630934-project] 10.222.0.13 "GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476" status: 404 len: 111 microversion: 2.1 time: 0.038332 May 13 13:32:29.839093 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 545/1063] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:29 2022] GET /compute/v2.1/servers/08c6080c-b39d-43f6-af1f-8707f33d3476 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:32:29.962602 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4afedd4f-7ccd-47c6-aa4b-534582334527 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:29.963971 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4afedd4f-7ccd-47c6-aa4b-534582334527 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:29.971996 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4afedd4f-7ccd-47c6-aa4b-534582334527 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:29.972993 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4afedd4f-7ccd-47c6-aa4b-534582334527 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:29.974705 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4afedd4f-7ccd-47c6-aa4b-534582334527 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:29.975246 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4afedd4f-7ccd-47c6-aa4b-534582334527 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:30.269045 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4afedd4f-7ccd-47c6-aa4b-534582334527 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:30.281054 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4afedd4f-7ccd-47c6-aa4b-534582334527 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1759 microversion: 2.1 time: 0.324345 May 13 13:32:30.281834 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 519/1064] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:32:29 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1759 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:30.564602 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-830ffd3a-2228-4ef5-b614-c82ba516d807 req-7c931990-0e73-4572-9588-feee8f5e6e4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4c37c70-bc64-4dc6-92eb-41a9df5a319f", "tag": "e4cad75c-2de5-45aa-88b3-e937529cf2a8"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:30.573305 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-830ffd3a-2228-4ef5-b614-c82ba516d807 req-7c931990-0e73-4572-9588-feee8f5e6e4a service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:30.573761 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-830ffd3a-2228-4ef5-b614-c82ba516d807 req-7c931990-0e73-4572-9588-feee8f5e6e4a service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:30.586176 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-830ffd3a-2228-4ef5-b614-c82ba516d807 req-7c931990-0e73-4572-9588-feee8f5e6e4a service nova] Creating event network-changed:e4cad75c-2de5-45aa-88b3-e937529cf2a8 for instance a4c37c70-bc64-4dc6-92eb-41a9df5a319f on hv-cinder-84163 May 13 13:32:30.592087 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-830ffd3a-2228-4ef5-b614-c82ba516d807 req-7c931990-0e73-4572-9588-feee8f5e6e4a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031064 May 13 13:32:30.592709 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 546/1065] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:33:03.480154 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5f5277d1-9839-4723-9722-67b89c0823f0 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1179136651"}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:33:03.481705 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5f5277d1-9839-4723-9722-67b89c0823f0 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:03.487957 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5f5277d1-9839-4723-9722-67b89c0823f0 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:03.488406 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5f5277d1-9839-4723-9722-67b89c0823f0 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:03.489188 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5f5277d1-9839-4723-9722-67b89c0823f0 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:03.489630 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5f5277d1-9839-4723-9722-67b89c0823f0 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:03.801354 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.network.security_group_api [None req-5f5277d1-9839-4723-9722-67b89c0823f0 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Removing security group e6009097-74fd-4fa4-aeb7-a5dd8874e7d3 from port bfe54fbd-567c-4293-a866-09fde88930de May 13 13:33:04.091601 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:33:04.091601 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Fri May 13 13:33:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e/action (ip 10.222.0.13) !!! May 13 13:33:04.236586 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5f5277d1-9839-4723-9722-67b89c0823f0 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "POST /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e/action" status: 202 len: 0 microversion: 2.1 time: 0.760556 May 13 13:33:04.245906 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 520/1066] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 13 13:33:03 2022] POST /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e/action => generated 0 bytes in 771 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:33:04.249550 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-36de1c71-619b-48a7-9fd9-f877ef069310 req-f9311b5e-8b97-4dac-940f-587b4e294cbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efaf0f78-60b2-4b3e-9d44-73149207472e", "tag": "bfe54fbd-567c-4293-a866-09fde88930de"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:33:04.262424 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-36de1c71-619b-48a7-9fd9-f877ef069310 req-f9311b5e-8b97-4dac-940f-587b4e294cbb service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:04.262878 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-36de1c71-619b-48a7-9fd9-f877ef069310 req-f9311b5e-8b97-4dac-940f-587b4e294cbb service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:04.291263 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-36de1c71-619b-48a7-9fd9-f877ef069310 req-f9311b5e-8b97-4dac-940f-587b4e294cbb service nova] Creating event network-changed:bfe54fbd-567c-4293-a866-09fde88930de for instance efaf0f78-60b2-4b3e-9d44-73149207472e on hv-cinder-84163 May 13 13:33:04.298061 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-36de1c71-619b-48a7-9fd9-f877ef069310 req-f9311b5e-8b97-4dac-940f-587b4e294cbb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053996 May 13 13:33:04.299199 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 547/1067] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:33:05.859448 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-00659a9a-5528-43d9-a6f4-227e0f9bd411 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:05.860005 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-00659a9a-5528-43d9-a6f4-227e0f9bd411 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:05.866091 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-00659a9a-5528-43d9-a6f4-227e0f9bd411 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:05.866574 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-00659a9a-5528-43d9-a6f4-227e0f9bd411 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:05.867353 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-00659a9a-5528-43d9-a6f4-227e0f9bd411 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:05.867793 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-00659a9a-5528-43d9-a6f4-227e0f9bd411 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:05.951932 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-00659a9a-5528-43d9-a6f4-227e0f9bd411 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lazy-loading 'services' on Instance uuid efaf0f78-60b2-4b3e-9d44-73149207472e {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:33:06.202932 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-00659a9a-5528-43d9-a6f4-227e0f9bd411 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "DELETE /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e/os-volume_attachments/ff25dd5a-4e55-4cbd-8c11-6ad590d159a0" status: 202 len: 0 microversion: 2.1 time: 0.348287 May 13 13:33:06.203774 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 521/1068] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 13 13:33:05 2022] DELETE /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e/os-volume_attachments/ff25dd5a-4e55-4cbd-8c11-6ad590d159a0 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:33:06.212773 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-40e5dec2-4c92-4970-ae8d-83de6ad26197 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:06.214007 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-40e5dec2-4c92-4970-ae8d-83de6ad26197 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:06.222273 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-40e5dec2-4c92-4970-ae8d-83de6ad26197 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:06.222810 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-40e5dec2-4c92-4970-ae8d-83de6ad26197 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:06.223662 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-40e5dec2-4c92-4970-ae8d-83de6ad26197 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:06.224192 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-40e5dec2-4c92-4970-ae8d-83de6ad26197 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:06.254946 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-40e5dec2-4c92-4970-ae8d-83de6ad26197 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046428 May 13 13:33:06.255627 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 548/1069] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 13 13:33:06 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:33:06.314963 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-a6977ed4-a959-4dbb-bdb7-c5dc964f2e5c req-5a7cb65a-1e50-460b-9c32-2ee7a810ba6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efaf0f78-60b2-4b3e-9d44-73149207472e", "tag": "bfe54fbd-567c-4293-a866-09fde88930de"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:33:06.323352 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-a6977ed4-a959-4dbb-bdb7-c5dc964f2e5c req-5a7cb65a-1e50-460b-9c32-2ee7a810ba6c service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:06.323799 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-a6977ed4-a959-4dbb-bdb7-c5dc964f2e5c req-5a7cb65a-1e50-460b-9c32-2ee7a810ba6c service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:06.339096 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-a6977ed4-a959-4dbb-bdb7-c5dc964f2e5c req-5a7cb65a-1e50-460b-9c32-2ee7a810ba6c service nova] Creating event network-changed:bfe54fbd-567c-4293-a866-09fde88930de for instance efaf0f78-60b2-4b3e-9d44-73149207472e on hv-cinder-84163 May 13 13:33:06.353939 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-a6977ed4-a959-4dbb-bdb7-c5dc964f2e5c req-5a7cb65a-1e50-460b-9c32-2ee7a810ba6c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042874 May 13 13:33:06.354886 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 522/1070] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:33:07.268399 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b3f35281-d6e8-497a-9883-cb14a4aba2a0 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:07.269227 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b3f35281-d6e8-497a-9883-cb14a4aba2a0 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:07.276462 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b3f35281-d6e8-497a-9883-cb14a4aba2a0 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:07.276913 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b3f35281-d6e8-497a-9883-cb14a4aba2a0 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:07.278347 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b3f35281-d6e8-497a-9883-cb14a4aba2a0 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:07.278799 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b3f35281-d6e8-497a-9883-cb14a4aba2a0 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:07.309261 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b3f35281-d6e8-497a-9883-cb14a4aba2a0 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045209 May 13 13:33:07.309987 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 549/1071] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 13 13:33:07 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:33:08.324472 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-199b33e1-91f8-4ee6-a629-218eaad0a8d8 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:08.325547 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-199b33e1-91f8-4ee6-a629-218eaad0a8d8 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:08.331946 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-199b33e1-91f8-4ee6-a629-218eaad0a8d8 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:08.332337 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-199b33e1-91f8-4ee6-a629-218eaad0a8d8 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:08.333134 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-199b33e1-91f8-4ee6-a629-218eaad0a8d8 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:08.333572 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-199b33e1-91f8-4ee6-a629-218eaad0a8d8 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:08.364929 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-199b33e1-91f8-4ee6-a629-218eaad0a8d8 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045443 May 13 13:33:08.365406 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 523/1072] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 13 13:33:08 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 13:33:08.375108 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-383c0084-4bdb-4d2e-92e4-1c35243548fe tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:08.375630 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-383c0084-4bdb-4d2e-92e4-1c35243548fe tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:08.382155 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-383c0084-4bdb-4d2e-92e4-1c35243548fe tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:08.382653 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-383c0084-4bdb-4d2e-92e4-1c35243548fe tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:08.383434 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-383c0084-4bdb-4d2e-92e4-1c35243548fe tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:08.383869 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-383c0084-4bdb-4d2e-92e4-1c35243548fe tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:08.568232 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-383c0084-4bdb-4d2e-92e4-1c35243548fe tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] HTTP exception thrown: Instance efaf0f78-60b2-4b3e-9d44-73149207472e is not attached to volume ff25dd5a-4e55-4cbd-8c11-6ad590d159a0 May 13 13:33:08.574429 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-383c0084-4bdb-4d2e-92e4-1c35243548fe tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Request method failure captured: May 13 13:33:08.574429 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: DELETE /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e/os-volume_attachments/ff25dd5a-4e55-4cbd-8c11-6ad590d159a0 HTTP/1.1 May 13 13:33:08.574429 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:33:08.574429 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:33:08.574429 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:33:08.574429 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:33:08.574429 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:33:08.574429 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:33:08.574429 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:33:08.574429 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:33:08.574429 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABifl2DVr2rlNcxYAVHWSHLete718nOtJY2VJm5QdWZkMq2jnFlAcmaC7qInp4OjuwBkKeCp3nUyh2vL85E9bIOipFPA0vDmMiCHGcSZ4ZTuLBFZY2zkqs8rVWNsw7K1R-wUugOtWcJLCFlKpil230cQipPzItate0De28yzBLSn_c13Ck May 13 13:33:08.574429 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:33:08.574429 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:33:08.574429 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:33:08.574429 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:33:08.574429 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:33:08.574429 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:33:08.574429 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: a3d1e5b7a3054d769e38bb8e12b202af May 13 13:33:08.574429 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-TestMinimumBasicScenario-1019921444 May 13 13:33:08.574429 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:33:08.574429 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:33:08.575899 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a3d1e5b7a3054d769e38bb8e12b202af", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3d1e5b7a3054d769e38bb8e12b202af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a3d1e5b7a3054d769e38bb8e12b202af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3d1e5b7a3054d769e38bb8e12b202af"}]}] May 13 13:33:08.575899 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-TestMinimumBasicScenario-1019921444 May 13 13:33:08.575899 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: a3d1e5b7a3054d769e38bb8e12b202af May 13 13:33:08.575899 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1019921444 May 13 13:33:08.575899 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-TestMinimumBasicScenario-1019921444-project May 13 13:33:08.575899 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:33:08.575899 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:33:08.575899 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: 51b8bece6df0455b8e3e5ffbc24c498b May 13 13:33:08.575899 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-TestMinimumBasicScenario-1019921444-project May 13 13:33:08.575899 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: > May 13 13:33:08.575899 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Instance efaf0f78-60b2-4b3e-9d44-73149207472e is not attached to volume ff25dd5a-4e55-4cbd-8c11-6ad590d159a0 May 13 13:33:08.576692 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'server_id': 'efaf0f78-60b2-4b3e-9d44-73149207472e', 'id': 'ff25dd5a-4e55-4cbd-8c11-6ad590d159a0'} May 13 13:33:08.576692 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:33:08.576692 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:33:08.576692 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 13 13:33:08.576692 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 13 13:33:08.576692 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 13:33:08.576692 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 13:33:08.576692 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 13 13:33:08.576692 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 13 13:33:08.576692 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ff25dd5a-4e55-4cbd-8c11-6ad590d159a0. May 13 13:33:08.576692 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:33:08.576692 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:33:08.576692 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:33:08.576692 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:33:08.576692 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:33:08.576692 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:33:08.576692 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:33:08.576692 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:33:08.576692 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:33:08.577974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:33:08.577974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 13 13:33:08.577974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 13 13:33:08.577974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efaf0f78-60b2-4b3e-9d44-73149207472e is not attached to volume ff25dd5a-4e55-4cbd-8c11-6ad590d159a0 May 13 13:33:08.577974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:33:08.577974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:33:08.577974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:33:08.577974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:33:08.577974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:33:08.577974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:33:08.577974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:33:08.577974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:33:08.577974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efaf0f78-60b2-4b3e-9d44-73149207472e is not attached to volume ff25dd5a-4e55-4cbd-8c11-6ad590d159a0 May 13 13:33:08.577974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:33:08.577974 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-383c0084-4bdb-4d2e-92e4-1c35243548fe tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Returning 404 to user: Instance efaf0f78-60b2-4b3e-9d44-73149207472e is not attached to volume ff25dd5a-4e55-4cbd-8c11-6ad590d159a0 {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:33:08.580008 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-383c0084-4bdb-4d2e-92e4-1c35243548fe tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "DELETE /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e/os-volume_attachments/ff25dd5a-4e55-4cbd-8c11-6ad590d159a0" status: 404 len: 154 microversion: 2.1 time: 0.204799 May 13 13:33:08.580008 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 550/1073] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 13 13:33:08 2022] DELETE /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e/os-volume_attachments/ff25dd5a-4e55-4cbd-8c11-6ad590d159a0 => generated 154 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:33:09.865030 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2e50e564-dd43-4d9d-b759-6a6661df88fe tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:09.865542 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2e50e564-dd43-4d9d-b759-6a6661df88fe tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:09.872461 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2e50e564-dd43-4d9d-b759-6a6661df88fe tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:09.872913 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2e50e564-dd43-4d9d-b759-6a6661df88fe tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:09.873690 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2e50e564-dd43-4d9d-b759-6a6661df88fe tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:09.874131 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2e50e564-dd43-4d9d-b759-6a6661df88fe tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:09.899674 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2e50e564-dd43-4d9d-b759-6a6661df88fe tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Going to try to terminate instance {{(pid=117720) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:33:10.173934 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2e50e564-dd43-4d9d-b759-6a6661df88fe tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "DELETE /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 204 len: 0 microversion: 2.1 time: 0.312296 May 13 13:33:10.174485 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 524/1074] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:33:09 2022] DELETE /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:33:10.182832 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e61a8bd1-9ac8-403e-a18b-d0c0db01109e tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:10.183940 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e61a8bd1-9ac8-403e-a18b-d0c0db01109e tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:10.190496 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e61a8bd1-9ac8-403e-a18b-d0c0db01109e tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:10.190967 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e61a8bd1-9ac8-403e-a18b-d0c0db01109e tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:10.191745 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e61a8bd1-9ac8-403e-a18b-d0c0db01109e tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:10.192290 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e61a8bd1-9ac8-403e-a18b-d0c0db01109e tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:10.328384 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e61a8bd1-9ac8-403e-a18b-d0c0db01109e tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:33:10.336451 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e61a8bd1-9ac8-403e-a18b-d0c0db01109e tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1553 microversion: 2.1 time: 0.157384 May 13 13:33:10.337028 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 551/1075] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:33:10 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:33:11.354251 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d68d2588-5a7d-4913-a7cb-2c0c26f1be77 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:11.354972 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d68d2588-5a7d-4913-a7cb-2c0c26f1be77 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:11.361484 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d68d2588-5a7d-4913-a7cb-2c0c26f1be77 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:11.361934 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d68d2588-5a7d-4913-a7cb-2c0c26f1be77 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:11.362729 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d68d2588-5a7d-4913-a7cb-2c0c26f1be77 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:11.363161 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d68d2588-5a7d-4913-a7cb-2c0c26f1be77 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:11.501145 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d68d2588-5a7d-4913-a7cb-2c0c26f1be77 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:33:11.508573 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d68d2588-5a7d-4913-a7cb-2c0c26f1be77 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1553 microversion: 2.1 time: 0.158572 May 13 13:33:11.509139 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 525/1076] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:33:11 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:33:12.528389 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-73aed903-6c25-4a86-a703-6b74440c9e24 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:12.533641 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-73aed903-6c25-4a86-a703-6b74440c9e24 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:12.535692 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73aed903-6c25-4a86-a703-6b74440c9e24 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:12.536151 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73aed903-6c25-4a86-a703-6b74440c9e24 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:12.537106 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73aed903-6c25-4a86-a703-6b74440c9e24 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:12.537547 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73aed903-6c25-4a86-a703-6b74440c9e24 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:12.675668 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-73aed903-6c25-4a86-a703-6b74440c9e24 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:33:12.683064 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-73aed903-6c25-4a86-a703-6b74440c9e24 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1553 microversion: 2.1 time: 0.158689 May 13 13:33:12.684524 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 552/1077] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:33:12 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:33:12.870072 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-4494622e-fab3-4975-a799-c3e05a89a1df req-2b3f67b0-83ff-4a1a-a4e4-bd7d58b498ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efaf0f78-60b2-4b3e-9d44-73149207472e", "name": "network-vif-deleted", "tag": "bfe54fbd-567c-4293-a866-09fde88930de"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:33:12.880217 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-4494622e-fab3-4975-a799-c3e05a89a1df req-2b3f67b0-83ff-4a1a-a4e4-bd7d58b498ca service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:12.880723 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-4494622e-fab3-4975-a799-c3e05a89a1df req-2b3f67b0-83ff-4a1a-a4e4-bd7d58b498ca service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:12.894526 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-4494622e-fab3-4975-a799-c3e05a89a1df req-2b3f67b0-83ff-4a1a-a4e4-bd7d58b498ca service nova] Creating event network-vif-deleted:bfe54fbd-567c-4293-a866-09fde88930de for instance efaf0f78-60b2-4b3e-9d44-73149207472e on hv-cinder-84163 May 13 13:33:12.899835 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-4494622e-fab3-4975-a799-c3e05a89a1df req-2b3f67b0-83ff-4a1a-a4e4-bd7d58b498ca service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033569 May 13 13:33:12.900461 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 526/1078] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:33:13.701598 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-389c36f3-c2a9-4518-ae09-ad1c894ce9ba tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:13.702326 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-389c36f3-c2a9-4518-ae09-ad1c894ce9ba tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:13.708645 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-389c36f3-c2a9-4518-ae09-ad1c894ce9ba tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:13.709087 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-389c36f3-c2a9-4518-ae09-ad1c894ce9ba tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:13.709854 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-389c36f3-c2a9-4518-ae09-ad1c894ce9ba tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:13.710312 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-389c36f3-c2a9-4518-ae09-ad1c894ce9ba tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:13.740616 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-389c36f3-c2a9-4518-ae09-ad1c894ce9ba tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:13.741104 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-389c36f3-c2a9-4518-ae09-ad1c894ce9ba tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:13.741554 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-389c36f3-c2a9-4518-ae09-ad1c894ce9ba tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lazy-loading 'fault' on Instance uuid efaf0f78-60b2-4b3e-9d44-73149207472e {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:33:13.782590 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-389c36f3-c2a9-4518-ae09-ad1c894ce9ba tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b8bece6df0455b8e3e5ffbc24c498b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d1e5b7a3054d769e38bb8e12b202af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:33:13.789805 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-389c36f3-c2a9-4518-ae09-ad1c894ce9ba tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 200 len: 1348 microversion: 2.1 time: 0.092946 May 13 13:33:13.792638 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 553/1079] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:33:13 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 1348 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:33:14.807773 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-773873dc-1d92-4f06-9094-a7a8f3670e87 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:14.809128 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-773873dc-1d92-4f06-9094-a7a8f3670e87 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] [instance: efaf0f78-60b2-4b3e-9d44-73149207472e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:14.815586 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-773873dc-1d92-4f06-9094-a7a8f3670e87 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:14.816032 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-773873dc-1d92-4f06-9094-a7a8f3670e87 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:14.816794 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-773873dc-1d92-4f06-9094-a7a8f3670e87 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:14.817221 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-773873dc-1d92-4f06-9094-a7a8f3670e87 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:14.830773 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-773873dc-1d92-4f06-9094-a7a8f3670e87 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] HTTP exception thrown: Instance efaf0f78-60b2-4b3e-9d44-73149207472e could not be found. May 13 13:33:14.832417 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-773873dc-1d92-4f06-9094-a7a8f3670e87 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Request method failure captured: May 13 13:33:14.832417 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e HTTP/1.1 May 13 13:33:14.832417 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept: application/json May 13 13:33:14.832417 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity May 13 13:33:14.832417 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Connection: close May 13 13:33:14.832417 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Length: 0 May 13 13:33:14.832417 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Type: application/json May 13 13:33:14.832417 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Host: 10.222.0.13 May 13 13:33:14.832417 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None May 13 13:33:14.832417 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 May 13 13:33:14.832417 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABifl2DVr2rlNcxYAVHWSHLete718nOtJY2VJm5QdWZkMq2jnFlAcmaC7qInp4OjuwBkKeCp3nUyh2vL85E9bIOipFPA0vDmMiCHGcSZ4ZTuLBFZY2zkqs8rVWNsw7K1R-wUugOtWcJLCFlKpil230cQipPzItate0De28yzBLSn_c13Ck May 13 13:33:14.832417 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Id: None May 13 13:33:14.832417 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Name: None May 13 13:33:14.832417 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed May 13 13:33:14.832417 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True May 13 13:33:14.832417 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default May 13 13:33:14.832417 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default May 13 13:33:14.832417 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Id: a3d1e5b7a3054d769e38bb8e12b202af May 13 13:33:14.832417 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-TestMinimumBasicScenario-1019921444 May 13 13:33:14.832417 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Role: member,reader May 13 13:33:14.832417 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Roles: member,reader May 13 13:33:14.834917 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a3d1e5b7a3054d769e38bb8e12b202af", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3d1e5b7a3054d769e38bb8e12b202af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a3d1e5b7a3054d769e38bb8e12b202af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3d1e5b7a3054d769e38bb8e12b202af"}]}] May 13 13:33:14.834917 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-TestMinimumBasicScenario-1019921444 May 13 13:33:14.834917 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Id: a3d1e5b7a3054d769e38bb8e12b202af May 13 13:33:14.834917 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1019921444 May 13 13:33:14.834917 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User: tempest-TestMinimumBasicScenario-1019921444-project May 13 13:33:14.834917 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default May 13 13:33:14.834917 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default May 13 13:33:14.834917 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Id: 51b8bece6df0455b8e3e5ffbc24c498b May 13 13:33:14.834917 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-TestMinimumBasicScenario-1019921444-project May 13 13:33:14.834917 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: method: > May 13 13:33:14.834917 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: exception: Instance efaf0f78-60b2-4b3e-9d44-73149207472e could not be found. May 13 13:33:14.834917 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: action_args: {'id': 'efaf0f78-60b2-4b3e-9d44-73149207472e'} May 13 13:33:14.835870 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:33:14.835870 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:33:14.835870 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:33:14.835870 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:33:14.835870 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:33:14.835870 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:33:14.835870 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:33:14.835870 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:33:14.835870 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:33:14.835870 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:33:14.835870 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efaf0f78-60b2-4b3e-9d44-73149207472e could not be found. May 13 13:33:14.835870 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:33:14.835870 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:33:14.835870 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:33:14.835870 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:33:14.835870 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:33:14.835870 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:33:14.835870 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:33:14.835870 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:33:14.835870 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:33:14.837249 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:33:14.837249 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:33:14.837249 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:33:14.837249 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:33:14.837249 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:33:14.837249 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:33:14.837249 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:33:14.837249 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efaf0f78-60b2-4b3e-9d44-73149207472e could not be found. May 13 13:33:14.837249 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:33:14.837249 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:33:14.837249 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:33:14.837249 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:33:14.837249 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:33:14.837249 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:33:14.837249 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:33:14.837249 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:33:14.837249 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efaf0f78-60b2-4b3e-9d44-73149207472e could not be found. May 13 13:33:14.837249 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:33:14.838698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-773873dc-1d92-4f06-9094-a7a8f3670e87 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Returning 404 to user: Instance efaf0f78-60b2-4b3e-9d44-73149207472e could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:33:14.838698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-773873dc-1d92-4f06-9094-a7a8f3670e87 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e" status: 404 len: 111 microversion: 2.1 time: 0.030358 May 13 13:33:14.838698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 527/1080] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:33:14 2022] GET /compute/v2.1/servers/efaf0f78-60b2-4b3e-9d44-73149207472e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:33:14.842601 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-9d6d957d-3a3d-4edc-81dd-4594eac1a900 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] Calling method '.version_select at 0x7fb0849ed4c0>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:14.917073 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-9d6d957d-3a3d-4edc-81dd-4594eac1a900 tempest-TestMinimumBasicScenario-1019921444 tempest-TestMinimumBasicScenario-1019921444-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-363617485" status: 202 len: 0 microversion: 2.1 time: 0.078338 May 13 13:33:14.921556 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 554/1081] 10.222.0.13 () {58 vars in 1268 bytes} [Fri May 13 13:33:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-363617485 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:34:26.419803 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d2a259f3-d484-401e-98c1-708fb6d5a6d8 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:26.420426 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d2a259f3-d484-401e-98c1-708fb6d5a6d8 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:26.426780 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d2a259f3-d484-401e-98c1-708fb6d5a6d8 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:26.427226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d2a259f3-d484-401e-98c1-708fb6d5a6d8 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:26.428176 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d2a259f3-d484-401e-98c1-708fb6d5a6d8 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:26.428612 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d2a259f3-d484-401e-98c1-708fb6d5a6d8 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:26.456205 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d2a259f3-d484-401e-98c1-708fb6d5a6d8 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Going to try to terminate instance {{(pid=117720) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:34:26.909069 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d2a259f3-d484-401e-98c1-708fb6d5a6d8 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f" status: 204 len: 0 microversion: 2.1 time: 0.493914 May 13 13:34:26.909662 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 528/1082] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:34:26 2022] DELETE /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:34:26.919408 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1accfa06-d730-4be5-9482-5b1ce114b714 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:26.920157 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1accfa06-d730-4be5-9482-5b1ce114b714 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:26.927532 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1accfa06-d730-4be5-9482-5b1ce114b714 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:26.927980 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1accfa06-d730-4be5-9482-5b1ce114b714 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:26.928763 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1accfa06-d730-4be5-9482-5b1ce114b714 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:26.929191 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1accfa06-d730-4be5-9482-5b1ce114b714 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:27.071828 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1accfa06-d730-4be5-9482-5b1ce114b714 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:27.075800 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1accfa06-d730-4be5-9482-5b1ce114b714 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f" status: 200 len: 1579 microversion: 2.1 time: 0.161813 May 13 13:34:27.076372 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 555/1083] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:34:26 2022] GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f => generated 1579 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:28.094807 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-806279da-438b-470e-8444-070d06f729c0 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:28.095610 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-806279da-438b-470e-8444-070d06f729c0 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:28.103397 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-806279da-438b-470e-8444-070d06f729c0 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:28.103840 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-806279da-438b-470e-8444-070d06f729c0 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:28.105194 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-806279da-438b-470e-8444-070d06f729c0 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:28.105723 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-806279da-438b-470e-8444-070d06f729c0 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:28.248468 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-806279da-438b-470e-8444-070d06f729c0 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:28.256462 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-806279da-438b-470e-8444-070d06f729c0 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f" status: 200 len: 1579 microversion: 2.1 time: 0.167181 May 13 13:34:28.257031 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 529/1084] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:34:28 2022] GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f => generated 1579 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:29.276047 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-34c0351d-31f2-4246-83b2-25fd1dfa82e8 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:29.277159 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-34c0351d-31f2-4246-83b2-25fd1dfa82e8 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:29.287279 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-34c0351d-31f2-4246-83b2-25fd1dfa82e8 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:29.288029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-34c0351d-31f2-4246-83b2-25fd1dfa82e8 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:29.289305 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-34c0351d-31f2-4246-83b2-25fd1dfa82e8 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:29.290030 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-34c0351d-31f2-4246-83b2-25fd1dfa82e8 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:29.361435 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-34c0351d-31f2-4246-83b2-25fd1dfa82e8 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:29.378557 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-34c0351d-31f2-4246-83b2-25fd1dfa82e8 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f" status: 200 len: 1511 microversion: 2.1 time: 0.102524 May 13 13:34:29.378557 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 556/1085] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:34:29 2022] GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f => generated 1511 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:29.857486 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-bfb48172-cc8d-41a9-8891-40a58b04e7e2 req-e6a8d20c-05e6-4227-98cf-d7b7fa413cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4c37c70-bc64-4dc6-92eb-41a9df5a319f", "name": "network-vif-deleted", "tag": "e4cad75c-2de5-45aa-88b3-e937529cf2a8"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:34:29.869001 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-bfb48172-cc8d-41a9-8891-40a58b04e7e2 req-e6a8d20c-05e6-4227-98cf-d7b7fa413cb1 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:29.869694 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-bfb48172-cc8d-41a9-8891-40a58b04e7e2 req-e6a8d20c-05e6-4227-98cf-d7b7fa413cb1 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:29.885424 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-bfb48172-cc8d-41a9-8891-40a58b04e7e2 req-e6a8d20c-05e6-4227-98cf-d7b7fa413cb1 service nova] Creating event network-vif-deleted:e4cad75c-2de5-45aa-88b3-e937529cf2a8 for instance a4c37c70-bc64-4dc6-92eb-41a9df5a319f on hv-cinder-84163 May 13 13:34:29.891365 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-bfb48172-cc8d-41a9-8891-40a58b04e7e2 req-e6a8d20c-05e6-4227-98cf-d7b7fa413cb1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213206 May 13 13:34:29.892044 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 530/1086] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:34:30.391356 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-9b87813f-7554-458b-90f1-36039af43d1e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:30.392021 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-9b87813f-7554-458b-90f1-36039af43d1e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:30.400439 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9b87813f-7554-458b-90f1-36039af43d1e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:30.400807 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9b87813f-7554-458b-90f1-36039af43d1e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:30.401597 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9b87813f-7554-458b-90f1-36039af43d1e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:30.402042 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9b87813f-7554-458b-90f1-36039af43d1e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:30.435548 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9b87813f-7554-458b-90f1-36039af43d1e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:30.436009 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9b87813f-7554-458b-90f1-36039af43d1e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:30.436451 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-9b87813f-7554-458b-90f1-36039af43d1e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lazy-loading 'fault' on Instance uuid a4c37c70-bc64-4dc6-92eb-41a9df5a319f {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:34:30.481988 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-9b87813f-7554-458b-90f1-36039af43d1e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:30.490985 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-9b87813f-7554-458b-90f1-36039af43d1e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f" status: 200 len: 1231 microversion: 2.1 time: 0.103968 May 13 13:34:30.491574 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 557/1087] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:34:30 2022] GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f => generated 1231 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:31.511794 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1c42afe8-5317-4809-84a8-4f9f19f32e59 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:31.524924 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1c42afe8-5317-4809-84a8-4f9f19f32e59 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:31.524924 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1c42afe8-5317-4809-84a8-4f9f19f32e59 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:31.524924 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1c42afe8-5317-4809-84a8-4f9f19f32e59 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:31.524924 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1c42afe8-5317-4809-84a8-4f9f19f32e59 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:31.525341 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1c42afe8-5317-4809-84a8-4f9f19f32e59 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:31.537849 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-1c42afe8-5317-4809-84a8-4f9f19f32e59 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] HTTP exception thrown: Instance a4c37c70-bc64-4dc6-92eb-41a9df5a319f could not be found. May 13 13:34:31.539539 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1c42afe8-5317-4809-84a8-4f9f19f32e59 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Request method failure captured: May 13 13:34:31.539539 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f HTTP/1.1 May 13 13:34:31.539539 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept: application/json May 13 13:34:31.539539 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity May 13 13:34:31.539539 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Connection: close May 13 13:34:31.539539 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Length: 0 May 13 13:34:31.539539 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Type: application/json May 13 13:34:31.539539 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Host: 10.222.0.13 May 13 13:34:31.539539 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None May 13 13:34:31.539539 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 May 13 13:34:31.539539 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABifl215GzSWxfcaNARM81XopICQ8JbCpgFT9dyr55BlJj4fgbgJg9RUpYucZ-dA24qKkawAZqyPR7h9k9-n6n440q09_B0VMX3x2TMFW8FvvlUh9ZehRYLjn-IpsrST-Ny3D5BodYdiuvMp1T4-wiaNTKy3S-I-z7C57_FuHz61RBsKiw May 13 13:34:31.539539 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Id: None May 13 13:34:31.539539 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Name: None May 13 13:34:31.539539 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed May 13 13:34:31.539539 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True May 13 13:34:31.539539 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default May 13 13:34:31.539539 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default May 13 13:34:31.539539 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Id: 6445798bd0f5475dba3878ea68e1eada May 13 13:34:31.539539 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-TestVolumeBootPattern-1980468939 May 13 13:34:31.539539 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Role: member,reader May 13 13:34:31.539539 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Roles: member,reader May 13 13:34:31.541252 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6445798bd0f5475dba3878ea68e1eada", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6445798bd0f5475dba3878ea68e1eada"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6445798bd0f5475dba3878ea68e1eada"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6445798bd0f5475dba3878ea68e1eada"}]}] May 13 13:34:31.541252 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-TestVolumeBootPattern-1980468939 May 13 13:34:31.541252 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 6445798bd0f5475dba3878ea68e1eada May 13 13:34:31.541252 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-TestVolumeBootPattern-1980468939 May 13 13:34:31.541252 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User: tempest-TestVolumeBootPattern-1980468939-project May 13 13:34:31.541252 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default May 13 13:34:31.541252 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default May 13 13:34:31.541252 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Id: 795a6f067c50494f99fea0b5afc82112 May 13 13:34:31.541252 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-TestVolumeBootPattern-1980468939-project May 13 13:34:31.541252 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: method: > May 13 13:34:31.541252 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: exception: Instance a4c37c70-bc64-4dc6-92eb-41a9df5a319f could not be found. May 13 13:34:31.541252 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: action_args: {'id': 'a4c37c70-bc64-4dc6-92eb-41a9df5a319f'} May 13 13:34:31.542460 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:34:31.542460 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:34:31.542460 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:34:31.542460 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:34:31.542460 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:34:31.542460 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:34:31.542460 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:34:31.542460 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:34:31.542460 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:34:31.542460 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:34:31.542460 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4c37c70-bc64-4dc6-92eb-41a9df5a319f could not be found. May 13 13:34:31.542460 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:34:31.542460 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:34:31.542460 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:34:31.542460 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:34:31.542460 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:34:31.542460 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:34:31.542460 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:34:31.542460 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:34:31.542460 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:34:31.543939 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:34:31.543939 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:34:31.543939 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:34:31.543939 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:34:31.543939 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:34:31.543939 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:34:31.543939 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:34:31.543939 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4c37c70-bc64-4dc6-92eb-41a9df5a319f could not be found. May 13 13:34:31.543939 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:34:31.543939 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:34:31.543939 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:34:31.543939 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:34:31.543939 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:34:31.543939 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:34:31.543939 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:34:31.543939 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:34:31.543939 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4c37c70-bc64-4dc6-92eb-41a9df5a319f could not be found. May 13 13:34:31.543939 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:34:31.545363 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1c42afe8-5317-4809-84a8-4f9f19f32e59 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Returning 404 to user: Instance a4c37c70-bc64-4dc6-92eb-41a9df5a319f could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:34:31.545363 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1c42afe8-5317-4809-84a8-4f9f19f32e59 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f" status: 404 len: 111 microversion: 2.1 time: 0.035392 May 13 13:34:31.545363 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 531/1088] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:34:31 2022] GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:34:31.641432 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-34f74275-1969-4161-8391-6b584293e013 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2099788223", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1117102184", "security_groups": [{"name": "tempest-secgroup-smoke-1011461249"}], "block_device_mapping_v2": [{"uuid": "3dc1291a-4804-460a-b190-4f32766a55ef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f93163e1-e8a9-4aac-a1de-53c0262bf902"}]}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:34:31.759853 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.network.neutron [None req-34f74275-1969-4161-8391-6b584293e013 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] validate_networks() for [('f93163e1-e8a9-4aac-a1de-53c0262bf902', None, None, None, None, None)] {{(pid=117721) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:34:32.160711 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-34f74275-1969-4161-8391-6b584293e013 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Flavor limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:34:32.161134 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-34f74275-1969-4161-8391-6b584293e013 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Image limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:34:32.161602 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-34f74275-1969-4161-8391-6b584293e013 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Flavor pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:34:32.162025 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-34f74275-1969-4161-8391-6b584293e013 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Image pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:34:32.162458 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-34f74275-1969-4161-8391-6b584293e013 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:34:32.171169 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-34f74275-1969-4161-8391-6b584293e013 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:32.171621 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-34f74275-1969-4161-8391-6b584293e013 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:32.172417 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-34f74275-1969-4161-8391-6b584293e013 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:32.172845 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-34f74275-1969-4161-8391-6b584293e013 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:32.189899 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-34f74275-1969-4161-8391-6b584293e013 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Getting quotas for project 6445798bd0f5475dba3878ea68e1eada. Resources: {'cores', 'instances', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:34:32.194016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-34f74275-1969-4161-8391-6b584293e013 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Getting quotas for user 795a6f067c50494f99fea0b5afc82112 and project 6445798bd0f5475dba3878ea68e1eada. Resources: {'cores', 'instances', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:34:32.252616 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-34f74275-1969-4161-8391-6b584293e013 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Going to run 1 instances... {{(pid=117721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:34:32.254703 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-34f74275-1969-4161-8391-6b584293e013 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: d79a77a4-9726-4d66-a733-568237a3b2fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3dc1291a-4804-460a-b190-4f32766a55ef',volume_size=None,volume_type=None)] {{(pid=117721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:34:32.683322 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR oslo.messaging._drivers.impl_rabbit [None req-34f74275-1969-4161-8391-6b584293e013 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [47936cfa-047d-407e-9cd0-1ae22228e412] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 13 13:34:33.691104 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO oslo.messaging._drivers.impl_rabbit [None req-34f74275-1969-4161-8391-6b584293e013 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [47936cfa-047d-407e-9cd0-1ae22228e412] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 59554. May 13 13:34:33.695170 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-34f74275-1969-4161-8391-6b584293e013 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.057866 May 13 13:34:33.696141 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 558/1089] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 13 13:34:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 2059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:34:33.706328 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-21df4a38-e1f6-4120-9ea3-1964067ab826 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:33.706944 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-21df4a38-e1f6-4120-9ea3-1964067ab826 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: d79a77a4-9726-4d66-a733-568237a3b2fb] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:33.766250 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-21df4a38-e1f6-4120-9ea3-1964067ab826 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:33.773689 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-21df4a38-e1f6-4120-9ea3-1964067ab826 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb" status: 200 len: 1095 microversion: 2.1 time: 0.071833 May 13 13:34:33.774270 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 532/1090] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:34:33 2022] GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:34.791310 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-976079fc-00b2-4528-9ec2-44dd51cb566d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:34.791921 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-976079fc-00b2-4528-9ec2-44dd51cb566d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: d79a77a4-9726-4d66-a733-568237a3b2fb] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:34.847572 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-976079fc-00b2-4528-9ec2-44dd51cb566d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:34.853901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-976079fc-00b2-4528-9ec2-44dd51cb566d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb" status: 200 len: 1095 microversion: 2.1 time: 0.066864 May 13 13:34:34.854710 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 559/1091] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:34:34 2022] GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:35.871646 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e35ef0e2-764d-46be-a2b9-05a2733c56a0 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:35.872253 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e35ef0e2-764d-46be-a2b9-05a2733c56a0 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: d79a77a4-9726-4d66-a733-568237a3b2fb] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:35.925087 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e35ef0e2-764d-46be-a2b9-05a2733c56a0 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:35.931457 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e35ef0e2-764d-46be-a2b9-05a2733c56a0 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb" status: 200 len: 1095 microversion: 2.1 time: 0.063959 May 13 13:34:35.932033 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 533/1092] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:34:35 2022] GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:34:36.949061 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-53cd5d91-5bf7-45b2-bcf9-c340fd3673eb tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:36.949653 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-53cd5d91-5bf7-45b2-bcf9-c340fd3673eb tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: d79a77a4-9726-4d66-a733-568237a3b2fb] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:37.008157 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-53cd5d91-5bf7-45b2-bcf9-c340fd3673eb tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:37.014875 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-53cd5d91-5bf7-45b2-bcf9-c340fd3673eb tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb" status: 200 len: 1095 microversion: 2.1 time: 0.069771 May 13 13:34:37.015445 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 560/1093] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:34:36 2022] GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:38.034402 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7a77c69d-3649-406c-8735-7f09a27aa5a5 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:38.034944 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7a77c69d-3649-406c-8735-7f09a27aa5a5 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: d79a77a4-9726-4d66-a733-568237a3b2fb] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:38.041954 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7a77c69d-3649-406c-8735-7f09a27aa5a5 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:38.042510 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7a77c69d-3649-406c-8735-7f09a27aa5a5 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:38.043479 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7a77c69d-3649-406c-8735-7f09a27aa5a5 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:38.043937 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7a77c69d-3649-406c-8735-7f09a27aa5a5 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:38.116298 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7a77c69d-3649-406c-8735-7f09a27aa5a5 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:38.123823 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7a77c69d-3649-406c-8735-7f09a27aa5a5 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb" status: 200 len: 1145 microversion: 2.1 time: 0.094616 May 13 13:34:38.124396 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 534/1094] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:34:38 2022] GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb => generated 1145 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:39.140608 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6c61fc12-b9b7-47c2-abdb-2824ece08a6d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:39.141220 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6c61fc12-b9b7-47c2-abdb-2824ece08a6d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: d79a77a4-9726-4d66-a733-568237a3b2fb] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:39.149454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6c61fc12-b9b7-47c2-abdb-2824ece08a6d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:39.149936 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6c61fc12-b9b7-47c2-abdb-2824ece08a6d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:39.150760 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6c61fc12-b9b7-47c2-abdb-2824ece08a6d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:39.151196 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6c61fc12-b9b7-47c2-abdb-2824ece08a6d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:39.217280 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6c61fc12-b9b7-47c2-abdb-2824ece08a6d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:39.225968 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6c61fc12-b9b7-47c2-abdb-2824ece08a6d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb" status: 200 len: 1137 microversion: 2.1 time: 0.089173 May 13 13:34:39.226702 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 561/1095] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:34:39 2022] GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb => generated 1137 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:40.249780 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a0b4f4f8-7a2b-40f0-aa7f-67ebd7afc050 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:40.250443 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a0b4f4f8-7a2b-40f0-aa7f-67ebd7afc050 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: d79a77a4-9726-4d66-a733-568237a3b2fb] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:40.257276 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a0b4f4f8-7a2b-40f0-aa7f-67ebd7afc050 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:40.257716 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a0b4f4f8-7a2b-40f0-aa7f-67ebd7afc050 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:40.258613 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a0b4f4f8-7a2b-40f0-aa7f-67ebd7afc050 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:40.259044 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a0b4f4f8-7a2b-40f0-aa7f-67ebd7afc050 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:40.324626 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a0b4f4f8-7a2b-40f0-aa7f-67ebd7afc050 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:40.332468 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a0b4f4f8-7a2b-40f0-aa7f-67ebd7afc050 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb" status: 200 len: 1211 microversion: 2.1 time: 0.086567 May 13 13:34:40.333034 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 535/1096] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:34:40 2022] GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:41.350795 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c171cfa4-7437-420a-a267-567c9752ce42 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:41.352055 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c171cfa4-7437-420a-a267-567c9752ce42 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: d79a77a4-9726-4d66-a733-568237a3b2fb] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:41.358843 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c171cfa4-7437-420a-a267-567c9752ce42 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:41.359306 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c171cfa4-7437-420a-a267-567c9752ce42 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:41.360072 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c171cfa4-7437-420a-a267-567c9752ce42 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:41.360515 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c171cfa4-7437-420a-a267-567c9752ce42 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:41.503638 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c171cfa4-7437-420a-a267-567c9752ce42 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:41.512127 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c171cfa4-7437-420a-a267-567c9752ce42 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb" status: 200 len: 1279 microversion: 2.1 time: 0.164693 May 13 13:34:41.512127 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 562/1097] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:34:41 2022] GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb => generated 1279 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:41.932963 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-46ab1ecd-7d9b-410a-a20d-2cd212d471c2 req-59ff95ed-250c-4cc7-8d74-79fb0f2e1612 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d79a77a4-9726-4d66-a733-568237a3b2fb", "tag": "71dd5492-9e7a-4331-96ca-71e55d876b81"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:34:41.944058 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-46ab1ecd-7d9b-410a-a20d-2cd212d471c2 req-59ff95ed-250c-4cc7-8d74-79fb0f2e1612 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:41.945426 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-46ab1ecd-7d9b-410a-a20d-2cd212d471c2 req-59ff95ed-250c-4cc7-8d74-79fb0f2e1612 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:41.969160 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-46ab1ecd-7d9b-410a-a20d-2cd212d471c2 req-59ff95ed-250c-4cc7-8d74-79fb0f2e1612 service nova] Creating event network-changed:71dd5492-9e7a-4331-96ca-71e55d876b81 for instance d79a77a4-9726-4d66-a733-568237a3b2fb on hv-cinder-84163 May 13 13:34:41.975535 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-46ab1ecd-7d9b-410a-a20d-2cd212d471c2 req-59ff95ed-250c-4cc7-8d74-79fb0f2e1612 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046359 May 13 13:34:41.976648 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 536/1098] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:34:42.528807 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6b48d67c-5a05-4220-8586-ec89e4cf6c05 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:42.529394 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6b48d67c-5a05-4220-8586-ec89e4cf6c05 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: d79a77a4-9726-4d66-a733-568237a3b2fb] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:42.537321 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6b48d67c-5a05-4220-8586-ec89e4cf6c05 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:42.537764 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6b48d67c-5a05-4220-8586-ec89e4cf6c05 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:42.538620 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6b48d67c-5a05-4220-8586-ec89e4cf6c05 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:42.539054 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6b48d67c-5a05-4220-8586-ec89e4cf6c05 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:42.680592 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6b48d67c-5a05-4220-8586-ec89e4cf6c05 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:42.689479 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6b48d67c-5a05-4220-8586-ec89e4cf6c05 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb" status: 200 len: 1267 microversion: 2.1 time: 0.163842 May 13 13:34:42.690343 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 563/1099] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:34:42 2022] GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:43.708263 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-34d32672-430a-4d5c-a9ac-1f61da21d1ea tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:43.708972 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-34d32672-430a-4d5c-a9ac-1f61da21d1ea tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: d79a77a4-9726-4d66-a733-568237a3b2fb] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:43.716017 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34d32672-430a-4d5c-a9ac-1f61da21d1ea tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:43.716516 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34d32672-430a-4d5c-a9ac-1f61da21d1ea tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:43.717437 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34d32672-430a-4d5c-a9ac-1f61da21d1ea tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:43.717881 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34d32672-430a-4d5c-a9ac-1f61da21d1ea tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:43.856354 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-34d32672-430a-4d5c-a9ac-1f61da21d1ea tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:43.864657 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-34d32672-430a-4d5c-a9ac-1f61da21d1ea tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb" status: 200 len: 1267 microversion: 2.1 time: 0.161496 May 13 13:34:43.865240 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 537/1100] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:34:43 2022] GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:44.881307 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e8b76ab5-0c79-4a8a-b300-80c6657d2656 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:44.881923 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e8b76ab5-0c79-4a8a-b300-80c6657d2656 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: d79a77a4-9726-4d66-a733-568237a3b2fb] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:44.888451 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e8b76ab5-0c79-4a8a-b300-80c6657d2656 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:44.888902 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e8b76ab5-0c79-4a8a-b300-80c6657d2656 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:44.889678 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e8b76ab5-0c79-4a8a-b300-80c6657d2656 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:44.890115 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e8b76ab5-0c79-4a8a-b300-80c6657d2656 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:45.030928 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e8b76ab5-0c79-4a8a-b300-80c6657d2656 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:45.038587 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e8b76ab5-0c79-4a8a-b300-80c6657d2656 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb" status: 200 len: 1267 microversion: 2.1 time: 0.161291 May 13 13:34:45.039166 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 564/1101] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:34:44 2022] GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:46.055867 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-707d35ae-6d02-4913-aaa2-befd06847cbe tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:46.056462 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-707d35ae-6d02-4913-aaa2-befd06847cbe tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: d79a77a4-9726-4d66-a733-568237a3b2fb] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:46.062563 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-707d35ae-6d02-4913-aaa2-befd06847cbe tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:46.063019 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-707d35ae-6d02-4913-aaa2-befd06847cbe tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:46.063865 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-707d35ae-6d02-4913-aaa2-befd06847cbe tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:46.064872 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-707d35ae-6d02-4913-aaa2-befd06847cbe tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:46.209393 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-707d35ae-6d02-4913-aaa2-befd06847cbe tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:46.216994 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-707d35ae-6d02-4913-aaa2-befd06847cbe tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb" status: 200 len: 1267 microversion: 2.1 time: 0.165172 May 13 13:34:46.217562 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 538/1102] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:34:46 2022] GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:47.234883 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a6bdf8fc-6d6a-4582-b74b-45ccb5c2431b tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:47.235492 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a6bdf8fc-6d6a-4582-b74b-45ccb5c2431b tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: d79a77a4-9726-4d66-a733-568237a3b2fb] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:47.242193 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a6bdf8fc-6d6a-4582-b74b-45ccb5c2431b tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:47.242665 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a6bdf8fc-6d6a-4582-b74b-45ccb5c2431b tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:47.243470 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a6bdf8fc-6d6a-4582-b74b-45ccb5c2431b tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:47.243904 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a6bdf8fc-6d6a-4582-b74b-45ccb5c2431b tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:47.381506 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a6bdf8fc-6d6a-4582-b74b-45ccb5c2431b tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:47.389029 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a6bdf8fc-6d6a-4582-b74b-45ccb5c2431b tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb" status: 200 len: 1267 microversion: 2.1 time: 0.158155 May 13 13:34:47.389606 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 565/1103] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:34:47 2022] GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:48.406698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-18a03338-872d-47f3-ba0c-321d6f57b047 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:48.407338 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-18a03338-872d-47f3-ba0c-321d6f57b047 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: d79a77a4-9726-4d66-a733-568237a3b2fb] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:48.414738 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-18a03338-872d-47f3-ba0c-321d6f57b047 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:48.415189 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-18a03338-872d-47f3-ba0c-321d6f57b047 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:48.415976 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-18a03338-872d-47f3-ba0c-321d6f57b047 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:48.416437 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-18a03338-872d-47f3-ba0c-321d6f57b047 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:48.557343 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-18a03338-872d-47f3-ba0c-321d6f57b047 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:48.565478 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-18a03338-872d-47f3-ba0c-321d6f57b047 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb" status: 200 len: 1267 microversion: 2.1 time: 0.162530 May 13 13:34:48.566060 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 539/1104] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:34:48 2022] GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:49.582557 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-12492e2f-b033-438a-b5b1-eceb0208ff17 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:49.588994 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-12492e2f-b033-438a-b5b1-eceb0208ff17 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: d79a77a4-9726-4d66-a733-568237a3b2fb] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:49.589784 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-12492e2f-b033-438a-b5b1-eceb0208ff17 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:49.590251 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-12492e2f-b033-438a-b5b1-eceb0208ff17 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:49.591028 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-12492e2f-b033-438a-b5b1-eceb0208ff17 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:49.591483 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-12492e2f-b033-438a-b5b1-eceb0208ff17 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:49.733905 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-12492e2f-b033-438a-b5b1-eceb0208ff17 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:49.747773 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-12492e2f-b033-438a-b5b1-eceb0208ff17 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb" status: 200 len: 1267 microversion: 2.1 time: 0.163241 May 13 13:34:49.747773 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 566/1105] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:34:49 2022] GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:50.758531 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0b4a15fa-5b72-4ab6-a36d-de5c212e9d22 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:50.759121 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0b4a15fa-5b72-4ab6-a36d-de5c212e9d22 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: d79a77a4-9726-4d66-a733-568237a3b2fb] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:50.765824 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0b4a15fa-5b72-4ab6-a36d-de5c212e9d22 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:50.766296 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0b4a15fa-5b72-4ab6-a36d-de5c212e9d22 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:50.767294 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0b4a15fa-5b72-4ab6-a36d-de5c212e9d22 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:50.767734 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0b4a15fa-5b72-4ab6-a36d-de5c212e9d22 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:50.905303 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0b4a15fa-5b72-4ab6-a36d-de5c212e9d22 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:50.917115 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0b4a15fa-5b72-4ab6-a36d-de5c212e9d22 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb" status: 200 len: 1267 microversion: 2.1 time: 0.162351 May 13 13:34:50.917688 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 540/1106] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:34:50 2022] GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:51.934630 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-14cbac0a-96e0-4049-9a21-1abe7afe907f tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:51.935254 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-14cbac0a-96e0-4049-9a21-1abe7afe907f tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: d79a77a4-9726-4d66-a733-568237a3b2fb] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:51.942594 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-14cbac0a-96e0-4049-9a21-1abe7afe907f tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:51.944590 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-14cbac0a-96e0-4049-9a21-1abe7afe907f tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:51.944590 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-14cbac0a-96e0-4049-9a21-1abe7afe907f tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:51.944590 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-14cbac0a-96e0-4049-9a21-1abe7afe907f tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:52.088842 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-14cbac0a-96e0-4049-9a21-1abe7afe907f tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:52.098149 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-14cbac0a-96e0-4049-9a21-1abe7afe907f tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb" status: 200 len: 1267 microversion: 2.1 time: 0.167506 May 13 13:34:52.098818 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 567/1107] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:34:51 2022] GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:52.206350 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-5dd75fc1-3f65-402c-8dc4-9557e167888b req-bbc2768d-ebe2-46f7-a20e-326630f0942f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79a77a4-9726-4d66-a733-568237a3b2fb", "name": "network-vif-plugged", "status": "completed", "tag": "71dd5492-9e7a-4331-96ca-71e55d876b81"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:34:52.214515 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-5dd75fc1-3f65-402c-8dc4-9557e167888b req-bbc2768d-ebe2-46f7-a20e-326630f0942f service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:52.214965 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-5dd75fc1-3f65-402c-8dc4-9557e167888b req-bbc2768d-ebe2-46f7-a20e-326630f0942f service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:52.235461 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-5dd75fc1-3f65-402c-8dc4-9557e167888b req-bbc2768d-ebe2-46f7-a20e-326630f0942f service nova] Creating event network-vif-plugged:71dd5492-9e7a-4331-96ca-71e55d876b81 for instance d79a77a4-9726-4d66-a733-568237a3b2fb on hv-cinder-84163 May 13 13:34:52.235461 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-5dd75fc1-3f65-402c-8dc4-9557e167888b req-bbc2768d-ebe2-46f7-a20e-326630f0942f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144060 May 13 13:34:52.235461 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 541/1108] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:34:53.115129 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-255a5a85-bde4-4965-8fd0-d7268921ab86 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:53.115765 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-255a5a85-bde4-4965-8fd0-d7268921ab86 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: d79a77a4-9726-4d66-a733-568237a3b2fb] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:53.122362 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-255a5a85-bde4-4965-8fd0-d7268921ab86 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:53.122802 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-255a5a85-bde4-4965-8fd0-d7268921ab86 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:53.123579 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-255a5a85-bde4-4965-8fd0-d7268921ab86 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:53.124006 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-255a5a85-bde4-4965-8fd0-d7268921ab86 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:53.269327 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-255a5a85-bde4-4965-8fd0-d7268921ab86 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:53.277016 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-255a5a85-bde4-4965-8fd0-d7268921ab86 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb" status: 200 len: 1267 microversion: 2.1 time: 0.165690 May 13 13:34:53.277561 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 568/1109] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:34:53 2022] GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:54.294983 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-55244206-4a91-46ed-b433-025d81b2420f tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:54.295820 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-55244206-4a91-46ed-b433-025d81b2420f tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: d79a77a4-9726-4d66-a733-568237a3b2fb] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:54.303273 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-55244206-4a91-46ed-b433-025d81b2420f tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:54.303713 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-55244206-4a91-46ed-b433-025d81b2420f tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:54.304474 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-55244206-4a91-46ed-b433-025d81b2420f tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:54.304903 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-55244206-4a91-46ed-b433-025d81b2420f tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:54.451735 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-55244206-4a91-46ed-b433-025d81b2420f tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:54.464658 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-55244206-4a91-46ed-b433-025d81b2420f tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb" status: 200 len: 1454 microversion: 2.1 time: 0.174102 May 13 13:34:54.465523 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 542/1110] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:34:54 2022] GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb => generated 1454 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:54.484842 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f1b6c135-7f28-480b-9e3a-96ac8ab8d36e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:54.485492 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f1b6c135-7f28-480b-9e3a-96ac8ab8d36e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: d79a77a4-9726-4d66-a733-568237a3b2fb] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:54.491804 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f1b6c135-7f28-480b-9e3a-96ac8ab8d36e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:54.492243 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f1b6c135-7f28-480b-9e3a-96ac8ab8d36e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:54.493007 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f1b6c135-7f28-480b-9e3a-96ac8ab8d36e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:54.493485 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f1b6c135-7f28-480b-9e3a-96ac8ab8d36e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:54.627633 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f1b6c135-7f28-480b-9e3a-96ac8ab8d36e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:54.635443 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f1b6c135-7f28-480b-9e3a-96ac8ab8d36e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb" status: 200 len: 1454 microversion: 2.1 time: 0.154491 May 13 13:34:54.636006 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 569/1111] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:34:54 2022] GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:56.676474 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-6c0c6dc0-970d-43d9-9eb0-9f69b28ed08d req-d34f8deb-6cd2-4757-becb-fcf8d08c7671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d79a77a4-9726-4d66-a733-568237a3b2fb", "tag": "71dd5492-9e7a-4331-96ca-71e55d876b81"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:34:56.685628 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-6c0c6dc0-970d-43d9-9eb0-9f69b28ed08d req-d34f8deb-6cd2-4757-becb-fcf8d08c7671 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:56.686073 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-6c0c6dc0-970d-43d9-9eb0-9f69b28ed08d req-d34f8deb-6cd2-4757-becb-fcf8d08c7671 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:56.703351 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-6c0c6dc0-970d-43d9-9eb0-9f69b28ed08d req-d34f8deb-6cd2-4757-becb-fcf8d08c7671 service nova] Creating event network-changed:71dd5492-9e7a-4331-96ca-71e55d876b81 for instance d79a77a4-9726-4d66-a733-568237a3b2fb on hv-cinder-84163 May 13 13:34:56.710497 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-6c0c6dc0-970d-43d9-9eb0-9f69b28ed08d req-d34f8deb-6cd2-4757-becb-fcf8d08c7671 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037991 May 13 13:34:56.711114 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 543/1112] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:36:03.342687 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:36:03.343302 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Fri May 13 13:36:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:36:24.099841 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:36:24.100458 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Fri May 13 13:36:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:36:32.538066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-af17d5ec-2662-47fa-8b90-353586f3e9dc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-69453770", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1117102184", "security_groups": [{"name": "tempest-secgroup-smoke-1011461249"}], "block_device_mapping_v2": [{"uuid": "6380b966-28aa-456c-8ea1-9d8cdb428ebe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f93163e1-e8a9-4aac-a1de-53c0262bf902"}]}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:36:32.646144 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.network.neutron [None req-af17d5ec-2662-47fa-8b90-353586f3e9dc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] validate_networks() for [('f93163e1-e8a9-4aac-a1de-53c0262bf902', None, None, None, None, None)] {{(pid=117721) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:36:33.345024 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-af17d5ec-2662-47fa-8b90-353586f3e9dc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Flavor limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:36:33.345441 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-af17d5ec-2662-47fa-8b90-353586f3e9dc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Image limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:36:33.345912 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-af17d5ec-2662-47fa-8b90-353586f3e9dc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Flavor pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:36:33.346345 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-af17d5ec-2662-47fa-8b90-353586f3e9dc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Image pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:36:33.346755 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-af17d5ec-2662-47fa-8b90-353586f3e9dc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:36:33.356815 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af17d5ec-2662-47fa-8b90-353586f3e9dc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:33.357268 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af17d5ec-2662-47fa-8b90-353586f3e9dc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:33.358477 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af17d5ec-2662-47fa-8b90-353586f3e9dc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:33.358920 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af17d5ec-2662-47fa-8b90-353586f3e9dc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:33.375518 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-af17d5ec-2662-47fa-8b90-353586f3e9dc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Getting quotas for project 6445798bd0f5475dba3878ea68e1eada. Resources: {'cores', 'instances', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:36:33.379425 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-af17d5ec-2662-47fa-8b90-353586f3e9dc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Getting quotas for user 795a6f067c50494f99fea0b5afc82112 and project 6445798bd0f5475dba3878ea68e1eada. Resources: {'cores', 'instances', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:36:33.438102 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-af17d5ec-2662-47fa-8b90-353586f3e9dc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Going to run 1 instances... {{(pid=117721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:36:33.440130 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-af17d5ec-2662-47fa-8b90-353586f3e9dc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a5b3716e-b5e3-4b0c-ab47-049b80ccb815] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6380b966-28aa-456c-8ea1-9d8cdb428ebe',volume_size=None,volume_type=None)] {{(pid=117721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:36:33.831278 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-af17d5ec-2662-47fa-8b90-353586f3e9dc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.297919 May 13 13:36:33.832126 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 570/1113] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 13 13:36:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 1299 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:36:33.845910 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-54ae97f4-f685-465b-bef7-1108ec4c4415 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:33.846804 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-54ae97f4-f685-465b-bef7-1108ec4c4415 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a5b3716e-b5e3-4b0c-ab47-049b80ccb815] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:33.916885 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-54ae97f4-f685-465b-bef7-1108ec4c4415 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:33.926194 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-54ae97f4-f685-465b-bef7-1108ec4c4415 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815" status: 200 len: 1093 microversion: 2.1 time: 0.086699 May 13 13:36:33.926983 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 544/1114] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:36:33 2022] GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815 => generated 1093 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:34.951802 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8a538882-65f8-4755-86ff-56dfccce9693 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:34.952416 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8a538882-65f8-4755-86ff-56dfccce9693 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a5b3716e-b5e3-4b0c-ab47-049b80ccb815] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:34.959049 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a538882-65f8-4755-86ff-56dfccce9693 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:34.959536 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a538882-65f8-4755-86ff-56dfccce9693 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:34.960792 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a538882-65f8-4755-86ff-56dfccce9693 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:34.961227 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a538882-65f8-4755-86ff-56dfccce9693 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:35.028509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8a538882-65f8-4755-86ff-56dfccce9693 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:35.036193 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8a538882-65f8-4755-86ff-56dfccce9693 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815" status: 200 len: 1143 microversion: 2.1 time: 0.088848 May 13 13:36:35.040734 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 571/1115] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:36:34 2022] GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815 => generated 1143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:36.055125 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-325aa11f-8453-4bd2-9ee6-5146cc266e48 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:36.055758 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-325aa11f-8453-4bd2-9ee6-5146cc266e48 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a5b3716e-b5e3-4b0c-ab47-049b80ccb815] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:36.063931 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-325aa11f-8453-4bd2-9ee6-5146cc266e48 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:36.064382 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-325aa11f-8453-4bd2-9ee6-5146cc266e48 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:36.065521 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-325aa11f-8453-4bd2-9ee6-5146cc266e48 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:36.066693 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-325aa11f-8453-4bd2-9ee6-5146cc266e48 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:36.143408 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-325aa11f-8453-4bd2-9ee6-5146cc266e48 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:36.151738 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-325aa11f-8453-4bd2-9ee6-5146cc266e48 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815" status: 200 len: 1199 microversion: 2.1 time: 0.101451 May 13 13:36:36.152313 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 545/1116] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:36:36 2022] GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815 => generated 1199 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:37.168529 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4d0741e3-82f8-435a-ae4a-5b31bff0ecf1 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:37.169147 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4d0741e3-82f8-435a-ae4a-5b31bff0ecf1 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a5b3716e-b5e3-4b0c-ab47-049b80ccb815] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:37.175826 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4d0741e3-82f8-435a-ae4a-5b31bff0ecf1 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:37.176270 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4d0741e3-82f8-435a-ae4a-5b31bff0ecf1 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:37.177665 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4d0741e3-82f8-435a-ae4a-5b31bff0ecf1 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:37.178143 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4d0741e3-82f8-435a-ae4a-5b31bff0ecf1 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:37.324342 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4d0741e3-82f8-435a-ae4a-5b31bff0ecf1 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:37.332833 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4d0741e3-82f8-435a-ae4a-5b31bff0ecf1 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815" status: 200 len: 1277 microversion: 2.1 time: 0.168035 May 13 13:36:37.333718 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 572/1117] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:36:37 2022] GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815 => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:37.927270 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-9835044c-cf0e-4075-b832-112613075178 req-a173ed98-3c42-4f3b-812b-f6d23ceedac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5b3716e-b5e3-4b0c-ab47-049b80ccb815", "tag": "f22f62c9-b9d0-41a6-8f65-2dad16c2daf4"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:36:37.936746 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-9835044c-cf0e-4075-b832-112613075178 req-a173ed98-3c42-4f3b-812b-f6d23ceedac3 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:37.939475 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-9835044c-cf0e-4075-b832-112613075178 req-a173ed98-3c42-4f3b-812b-f6d23ceedac3 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:37.951199 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-9835044c-cf0e-4075-b832-112613075178 req-a173ed98-3c42-4f3b-812b-f6d23ceedac3 service nova] Creating event network-changed:f22f62c9-b9d0-41a6-8f65-2dad16c2daf4 for instance a5b3716e-b5e3-4b0c-ab47-049b80ccb815 on hv-cinder-84163 May 13 13:36:37.957317 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-9835044c-cf0e-4075-b832-112613075178 req-a173ed98-3c42-4f3b-812b-f6d23ceedac3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039229 May 13 13:36:37.958134 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 546/1118] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:36:38.351061 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0f9a3cd1-18ee-4d04-a2ee-4f336101e55d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:38.351753 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0f9a3cd1-18ee-4d04-a2ee-4f336101e55d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a5b3716e-b5e3-4b0c-ab47-049b80ccb815] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:38.358546 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0f9a3cd1-18ee-4d04-a2ee-4f336101e55d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:38.363229 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0f9a3cd1-18ee-4d04-a2ee-4f336101e55d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:38.364052 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0f9a3cd1-18ee-4d04-a2ee-4f336101e55d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:38.364494 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0f9a3cd1-18ee-4d04-a2ee-4f336101e55d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:38.497633 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0f9a3cd1-18ee-4d04-a2ee-4f336101e55d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:38.505093 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0f9a3cd1-18ee-4d04-a2ee-4f336101e55d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815" status: 200 len: 1265 microversion: 2.1 time: 0.158303 May 13 13:36:38.505653 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 573/1119] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:36:38 2022] GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:39.524631 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-78c8a1af-8d4e-4160-972b-592fd320fb58 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:39.525291 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-78c8a1af-8d4e-4160-972b-592fd320fb58 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a5b3716e-b5e3-4b0c-ab47-049b80ccb815] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:39.532149 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-78c8a1af-8d4e-4160-972b-592fd320fb58 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:39.532604 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-78c8a1af-8d4e-4160-972b-592fd320fb58 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:39.533391 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-78c8a1af-8d4e-4160-972b-592fd320fb58 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:39.533829 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-78c8a1af-8d4e-4160-972b-592fd320fb58 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:39.672782 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-78c8a1af-8d4e-4160-972b-592fd320fb58 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:39.681304 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-78c8a1af-8d4e-4160-972b-592fd320fb58 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815" status: 200 len: 1265 microversion: 2.1 time: 0.161642 May 13 13:36:39.681879 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 547/1120] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:36:39 2022] GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:40.698584 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-9c0a7d74-5e9f-49f8-96b1-2c7fe8f3ff27 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:40.699210 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-9c0a7d74-5e9f-49f8-96b1-2c7fe8f3ff27 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a5b3716e-b5e3-4b0c-ab47-049b80ccb815] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:40.705500 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9c0a7d74-5e9f-49f8-96b1-2c7fe8f3ff27 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:40.705946 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9c0a7d74-5e9f-49f8-96b1-2c7fe8f3ff27 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:40.706778 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9c0a7d74-5e9f-49f8-96b1-2c7fe8f3ff27 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:40.707191 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9c0a7d74-5e9f-49f8-96b1-2c7fe8f3ff27 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:40.846575 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-9c0a7d74-5e9f-49f8-96b1-2c7fe8f3ff27 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:40.854998 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-9c0a7d74-5e9f-49f8-96b1-2c7fe8f3ff27 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815" status: 200 len: 1265 microversion: 2.1 time: 0.160922 May 13 13:36:40.855560 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 574/1121] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:36:40 2022] GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:41.872301 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c8e4a0e8-ce34-433c-8354-842db80b8690 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:41.872916 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c8e4a0e8-ce34-433c-8354-842db80b8690 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a5b3716e-b5e3-4b0c-ab47-049b80ccb815] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:41.879383 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c8e4a0e8-ce34-433c-8354-842db80b8690 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:41.879822 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c8e4a0e8-ce34-433c-8354-842db80b8690 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:41.880581 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c8e4a0e8-ce34-433c-8354-842db80b8690 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:41.881008 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c8e4a0e8-ce34-433c-8354-842db80b8690 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:42.014886 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c8e4a0e8-ce34-433c-8354-842db80b8690 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:42.022380 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c8e4a0e8-ce34-433c-8354-842db80b8690 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815" status: 200 len: 1265 microversion: 2.1 time: 0.153903 May 13 13:36:42.023142 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 548/1122] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:36:41 2022] GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:43.129453 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-639e4439-70c8-46ab-917f-08db8242d201 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:43.130066 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-639e4439-70c8-46ab-917f-08db8242d201 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a5b3716e-b5e3-4b0c-ab47-049b80ccb815] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:43.136597 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-639e4439-70c8-46ab-917f-08db8242d201 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:43.136980 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-639e4439-70c8-46ab-917f-08db8242d201 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:43.137756 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-639e4439-70c8-46ab-917f-08db8242d201 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:43.138235 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-639e4439-70c8-46ab-917f-08db8242d201 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:43.277572 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-639e4439-70c8-46ab-917f-08db8242d201 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:43.284912 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-639e4439-70c8-46ab-917f-08db8242d201 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815" status: 200 len: 1265 microversion: 2.1 time: 0.249319 May 13 13:36:43.285473 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 575/1123] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:36:43 2022] GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815 => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:44.302460 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8f31c87f-41b9-4023-b374-6f0b6b4ea7cf tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:44.303073 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8f31c87f-41b9-4023-b374-6f0b6b4ea7cf tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a5b3716e-b5e3-4b0c-ab47-049b80ccb815] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:44.310799 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8f31c87f-41b9-4023-b374-6f0b6b4ea7cf tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:44.311188 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8f31c87f-41b9-4023-b374-6f0b6b4ea7cf tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:44.311965 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8f31c87f-41b9-4023-b374-6f0b6b4ea7cf tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:44.312400 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8f31c87f-41b9-4023-b374-6f0b6b4ea7cf tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:44.453231 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8f31c87f-41b9-4023-b374-6f0b6b4ea7cf tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:44.460895 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8f31c87f-41b9-4023-b374-6f0b6b4ea7cf tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815" status: 200 len: 1265 microversion: 2.1 time: 0.162291 May 13 13:36:44.461471 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 549/1124] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:36:44 2022] GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:45.478242 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-fa42e188-53fd-4cc5-b143-977f8018e158 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:45.478847 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-fa42e188-53fd-4cc5-b143-977f8018e158 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a5b3716e-b5e3-4b0c-ab47-049b80ccb815] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:45.484991 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fa42e188-53fd-4cc5-b143-977f8018e158 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:45.485433 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fa42e188-53fd-4cc5-b143-977f8018e158 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:45.486190 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fa42e188-53fd-4cc5-b143-977f8018e158 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:45.486642 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fa42e188-53fd-4cc5-b143-977f8018e158 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:45.623241 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-fa42e188-53fd-4cc5-b143-977f8018e158 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:45.630533 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-fa42e188-53fd-4cc5-b143-977f8018e158 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815" status: 200 len: 1265 microversion: 2.1 time: 0.157146 May 13 13:36:45.631303 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 576/1125] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:36:45 2022] GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:46.647980 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-44871d5d-2b64-4e10-9cf4-faac0009e0e4 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:46.648607 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-44871d5d-2b64-4e10-9cf4-faac0009e0e4 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a5b3716e-b5e3-4b0c-ab47-049b80ccb815] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:46.654698 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-44871d5d-2b64-4e10-9cf4-faac0009e0e4 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:46.655162 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-44871d5d-2b64-4e10-9cf4-faac0009e0e4 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:46.655942 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-44871d5d-2b64-4e10-9cf4-faac0009e0e4 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:46.656380 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-44871d5d-2b64-4e10-9cf4-faac0009e0e4 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:46.790743 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-44871d5d-2b64-4e10-9cf4-faac0009e0e4 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:46.798451 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-44871d5d-2b64-4e10-9cf4-faac0009e0e4 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815" status: 200 len: 1265 microversion: 2.1 time: 0.154975 May 13 13:36:46.799361 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 550/1126] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:36:46 2022] GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:47.815962 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-73e3475d-21b8-42b5-8ff5-5d685e3a14dd tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:47.816626 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-73e3475d-21b8-42b5-8ff5-5d685e3a14dd tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a5b3716e-b5e3-4b0c-ab47-049b80ccb815] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:47.823258 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73e3475d-21b8-42b5-8ff5-5d685e3a14dd tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:47.823703 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73e3475d-21b8-42b5-8ff5-5d685e3a14dd tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:47.824469 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73e3475d-21b8-42b5-8ff5-5d685e3a14dd tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:47.824905 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73e3475d-21b8-42b5-8ff5-5d685e3a14dd tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:47.956411 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-73e3475d-21b8-42b5-8ff5-5d685e3a14dd tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:47.963946 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-73e3475d-21b8-42b5-8ff5-5d685e3a14dd tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815" status: 200 len: 1265 microversion: 2.1 time: 0.151867 May 13 13:36:47.964504 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 577/1127] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:36:47 2022] GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:48.769702 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-011afc33-7b6c-4840-a13c-a47220efa31d req-bcc4de41-fc43-4683-ac0a-aa6898cd7596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5b3716e-b5e3-4b0c-ab47-049b80ccb815", "name": "network-vif-plugged", "status": "completed", "tag": "f22f62c9-b9d0-41a6-8f65-2dad16c2daf4"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:36:48.779065 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-011afc33-7b6c-4840-a13c-a47220efa31d req-bcc4de41-fc43-4683-ac0a-aa6898cd7596 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:48.779547 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-011afc33-7b6c-4840-a13c-a47220efa31d req-bcc4de41-fc43-4683-ac0a-aa6898cd7596 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:48.792033 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-011afc33-7b6c-4840-a13c-a47220efa31d req-bcc4de41-fc43-4683-ac0a-aa6898cd7596 service nova] Creating event network-vif-plugged:f22f62c9-b9d0-41a6-8f65-2dad16c2daf4 for instance a5b3716e-b5e3-4b0c-ab47-049b80ccb815 on hv-cinder-84163 May 13 13:36:48.797178 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-011afc33-7b6c-4840-a13c-a47220efa31d req-bcc4de41-fc43-4683-ac0a-aa6898cd7596 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031121 May 13 13:36:48.797800 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 551/1128] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:36:48.980996 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-82a7309d-52c7-419c-ba00-927cf4b9d780 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:48.982834 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-82a7309d-52c7-419c-ba00-927cf4b9d780 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a5b3716e-b5e3-4b0c-ab47-049b80ccb815] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:48.989791 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-82a7309d-52c7-419c-ba00-927cf4b9d780 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:48.990267 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-82a7309d-52c7-419c-ba00-927cf4b9d780 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:48.991058 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-82a7309d-52c7-419c-ba00-927cf4b9d780 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:48.991501 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-82a7309d-52c7-419c-ba00-927cf4b9d780 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:49.131410 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-82a7309d-52c7-419c-ba00-927cf4b9d780 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:49.139377 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-82a7309d-52c7-419c-ba00-927cf4b9d780 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815" status: 200 len: 1265 microversion: 2.1 time: 0.162237 May 13 13:36:49.139958 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 578/1129] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:36:48 2022] GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:50.157791 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-962a5177-1e08-4bcb-9582-a972be3905a2 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:50.158540 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-962a5177-1e08-4bcb-9582-a972be3905a2 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a5b3716e-b5e3-4b0c-ab47-049b80ccb815] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:50.166370 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-962a5177-1e08-4bcb-9582-a972be3905a2 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:50.166821 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-962a5177-1e08-4bcb-9582-a972be3905a2 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:50.167593 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-962a5177-1e08-4bcb-9582-a972be3905a2 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:50.168027 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-962a5177-1e08-4bcb-9582-a972be3905a2 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:50.306584 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-962a5177-1e08-4bcb-9582-a972be3905a2 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:50.314590 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-962a5177-1e08-4bcb-9582-a972be3905a2 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815" status: 200 len: 1265 microversion: 2.1 time: 0.161414 May 13 13:36:50.318974 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 552/1130] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:36:50 2022] GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:51.331908 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7a2ff46b-7067-42b7-aedc-c4d4ae694b8e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:51.332509 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7a2ff46b-7067-42b7-aedc-c4d4ae694b8e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a5b3716e-b5e3-4b0c-ab47-049b80ccb815] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:51.339849 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7a2ff46b-7067-42b7-aedc-c4d4ae694b8e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:51.340293 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7a2ff46b-7067-42b7-aedc-c4d4ae694b8e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:51.341056 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7a2ff46b-7067-42b7-aedc-c4d4ae694b8e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:51.341485 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7a2ff46b-7067-42b7-aedc-c4d4ae694b8e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:51.483280 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7a2ff46b-7067-42b7-aedc-c4d4ae694b8e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:51.490901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7a2ff46b-7067-42b7-aedc-c4d4ae694b8e tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815" status: 200 len: 1452 microversion: 2.1 time: 0.162840 May 13 13:36:51.491474 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 579/1131] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:36:51 2022] GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:51.507226 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-00c7efae-e6af-42ca-a624-fc2f97b5b4cb tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:51.511708 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-00c7efae-e6af-42ca-a624-fc2f97b5b4cb tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a5b3716e-b5e3-4b0c-ab47-049b80ccb815] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:51.514419 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-00c7efae-e6af-42ca-a624-fc2f97b5b4cb tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:51.514869 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-00c7efae-e6af-42ca-a624-fc2f97b5b4cb tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:51.515644 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-00c7efae-e6af-42ca-a624-fc2f97b5b4cb tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:51.516078 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-00c7efae-e6af-42ca-a624-fc2f97b5b4cb tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:51.653026 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-00c7efae-e6af-42ca-a624-fc2f97b5b4cb tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:51.660441 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-00c7efae-e6af-42ca-a624-fc2f97b5b4cb tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815" status: 200 len: 1452 microversion: 2.1 time: 0.157131 May 13 13:36:51.661009 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 553/1132] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:36:51 2022] GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:53.671920 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-3ddf804f-5b27-4c3e-8a02-cf9073d3d353 req-041d8291-4fd4-48c8-a6c9-d784feb01a93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5b3716e-b5e3-4b0c-ab47-049b80ccb815", "tag": "f22f62c9-b9d0-41a6-8f65-2dad16c2daf4"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:36:53.685309 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-3ddf804f-5b27-4c3e-8a02-cf9073d3d353 req-041d8291-4fd4-48c8-a6c9-d784feb01a93 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:53.685762 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-3ddf804f-5b27-4c3e-8a02-cf9073d3d353 req-041d8291-4fd4-48c8-a6c9-d784feb01a93 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:53.699807 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-3ddf804f-5b27-4c3e-8a02-cf9073d3d353 req-041d8291-4fd4-48c8-a6c9-d784feb01a93 service nova] Creating event network-changed:f22f62c9-b9d0-41a6-8f65-2dad16c2daf4 for instance a5b3716e-b5e3-4b0c-ab47-049b80ccb815 on hv-cinder-84163 May 13 13:36:53.704836 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-3ddf804f-5b27-4c3e-8a02-cf9073d3d353 req-041d8291-4fd4-48c8-a6c9-d784feb01a93 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036607 May 13 13:36:53.705454 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 580/1133] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:38:12.858206 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:38:12.858799 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Fri May 13 13:38:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:38:21.656796 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-10fb496e-3f1e-45ea-8c1f-1a49633ed2bc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:38:21.657957 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-10fb496e-3f1e-45ea-8c1f-1a49633ed2bc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a5b3716e-b5e3-4b0c-ab47-049b80ccb815] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:38:21.667608 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-10fb496e-3f1e-45ea-8c1f-1a49633ed2bc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:21.668231 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-10fb496e-3f1e-45ea-8c1f-1a49633ed2bc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:21.669221 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-10fb496e-3f1e-45ea-8c1f-1a49633ed2bc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:21.669660 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-10fb496e-3f1e-45ea-8c1f-1a49633ed2bc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:21.697756 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-10fb496e-3f1e-45ea-8c1f-1a49633ed2bc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a5b3716e-b5e3-4b0c-ab47-049b80ccb815] Going to try to terminate instance {{(pid=117720) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:38:21.729978 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-be689bf0-ffb8-4bfd-9dd2-04cc444ba29f req-1d1184d4-427d-4c2e-9d64-9b6fb096752b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5b3716e-b5e3-4b0c-ab47-049b80ccb815", "tag": "f22f62c9-b9d0-41a6-8f65-2dad16c2daf4"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:38:21.740385 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-be689bf0-ffb8-4bfd-9dd2-04cc444ba29f req-1d1184d4-427d-4c2e-9d64-9b6fb096752b service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:21.742302 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-be689bf0-ffb8-4bfd-9dd2-04cc444ba29f req-1d1184d4-427d-4c2e-9d64-9b6fb096752b service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:21.752603 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-be689bf0-ffb8-4bfd-9dd2-04cc444ba29f req-1d1184d4-427d-4c2e-9d64-9b6fb096752b service nova] Creating event network-changed:f22f62c9-b9d0-41a6-8f65-2dad16c2daf4 for instance a5b3716e-b5e3-4b0c-ab47-049b80ccb815 on hv-cinder-84163 May 13 13:38:21.758558 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-be689bf0-ffb8-4bfd-9dd2-04cc444ba29f req-1d1184d4-427d-4c2e-9d64-9b6fb096752b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105214 May 13 13:38:21.759155 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 581/1134] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:38:21.967497 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-10fb496e-3f1e-45ea-8c1f-1a49633ed2bc tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815" status: 204 len: 0 microversion: 2.1 time: 0.315816 May 13 13:38:21.968434 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 554/1135] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:38:21 2022] DELETE /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:38:21.977929 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-9ffddb8f-280b-482e-b21b-a19636d6c329 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:38:21.978727 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-9ffddb8f-280b-482e-b21b-a19636d6c329 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a5b3716e-b5e3-4b0c-ab47-049b80ccb815] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:38:21.984880 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9ffddb8f-280b-482e-b21b-a19636d6c329 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:21.985334 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9ffddb8f-280b-482e-b21b-a19636d6c329 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:21.986921 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9ffddb8f-280b-482e-b21b-a19636d6c329 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:21.987362 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9ffddb8f-280b-482e-b21b-a19636d6c329 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:22.179816 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-9ffddb8f-280b-482e-b21b-a19636d6c329 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:38:22.187423 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-9ffddb8f-280b-482e-b21b-a19636d6c329 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815" status: 200 len: 1577 microversion: 2.1 time: 0.214031 May 13 13:38:22.188226 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 582/1136] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:38:21 2022] GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815 => generated 1577 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:38:23.206772 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0333bd70-69d6-4a8c-9d99-e891b60ec7b9 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:38:23.207484 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0333bd70-69d6-4a8c-9d99-e891b60ec7b9 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a5b3716e-b5e3-4b0c-ab47-049b80ccb815] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:38:23.213886 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0333bd70-69d6-4a8c-9d99-e891b60ec7b9 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:23.214364 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0333bd70-69d6-4a8c-9d99-e891b60ec7b9 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:23.215134 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0333bd70-69d6-4a8c-9d99-e891b60ec7b9 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:23.215570 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0333bd70-69d6-4a8c-9d99-e891b60ec7b9 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:23.398529 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0333bd70-69d6-4a8c-9d99-e891b60ec7b9 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:38:23.405912 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0333bd70-69d6-4a8c-9d99-e891b60ec7b9 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815" status: 200 len: 1577 microversion: 2.1 time: 0.204666 May 13 13:38:23.406515 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 555/1137] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:38:23 2022] GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815 => generated 1577 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:38:24.023398 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-c11845e6-92a7-4226-9ea1-1cb228f4e59b req-e4fe8b42-d171-4db7-bb2a-1860f92ece05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5b3716e-b5e3-4b0c-ab47-049b80ccb815", "name": "network-vif-deleted", "tag": "f22f62c9-b9d0-41a6-8f65-2dad16c2daf4"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:38:24.031599 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-c11845e6-92a7-4226-9ea1-1cb228f4e59b req-e4fe8b42-d171-4db7-bb2a-1860f92ece05 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:24.033689 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-c11845e6-92a7-4226-9ea1-1cb228f4e59b req-e4fe8b42-d171-4db7-bb2a-1860f92ece05 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:24.043017 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-c11845e6-92a7-4226-9ea1-1cb228f4e59b req-e4fe8b42-d171-4db7-bb2a-1860f92ece05 service nova] Creating event network-vif-deleted:f22f62c9-b9d0-41a6-8f65-2dad16c2daf4 for instance a5b3716e-b5e3-4b0c-ab47-049b80ccb815 on hv-cinder-84163 May 13 13:38:24.047829 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-c11845e6-92a7-4226-9ea1-1cb228f4e59b req-e4fe8b42-d171-4db7-bb2a-1860f92ece05 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028092 May 13 13:38:24.048640 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 583/1138] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:38:24.424636 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-63156ef4-ded6-44c4-bded-367a5368a91a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:38:24.425269 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-63156ef4-ded6-44c4-bded-367a5368a91a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a5b3716e-b5e3-4b0c-ab47-049b80ccb815] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:38:24.431826 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-63156ef4-ded6-44c4-bded-367a5368a91a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:24.432264 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-63156ef4-ded6-44c4-bded-367a5368a91a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:24.433053 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-63156ef4-ded6-44c4-bded-367a5368a91a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:24.433527 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-63156ef4-ded6-44c4-bded-367a5368a91a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:24.497813 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-63156ef4-ded6-44c4-bded-367a5368a91a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:38:24.505217 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-63156ef4-ded6-44c4-bded-367a5368a91a tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815" status: 200 len: 1224 microversion: 2.1 time: 0.084640 May 13 13:38:24.505788 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 556/1139] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:38:24 2022] GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:38:25.523156 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-af641d3c-dc71-4f83-8d13-ce5f4601255b tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:38:25.523736 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-af641d3c-dc71-4f83-8d13-ce5f4601255b tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a5b3716e-b5e3-4b0c-ab47-049b80ccb815] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:38:25.529856 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af641d3c-dc71-4f83-8d13-ce5f4601255b tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:25.530346 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af641d3c-dc71-4f83-8d13-ce5f4601255b tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:25.531114 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af641d3c-dc71-4f83-8d13-ce5f4601255b tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:25.531551 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af641d3c-dc71-4f83-8d13-ce5f4601255b tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:25.544897 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-af641d3c-dc71-4f83-8d13-ce5f4601255b tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] HTTP exception thrown: Instance a5b3716e-b5e3-4b0c-ab47-049b80ccb815 could not be found. May 13 13:38:25.546535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-af641d3c-dc71-4f83-8d13-ce5f4601255b tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Request method failure captured: May 13 13:38:25.546535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815 HTTP/1.1 May 13 13:38:25.546535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:38:25.546535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:38:25.546535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:38:25.546535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:38:25.546535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:38:25.546535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:38:25.546535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:38:25.546535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:38:25.546535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABifl215GzSWxfcaNARM81XopICQ8JbCpgFT9dyr55BlJj4fgbgJg9RUpYucZ-dA24qKkawAZqyPR7h9k9-n6n440q09_B0VMX3x2TMFW8FvvlUh9ZehRYLjn-IpsrST-Ny3D5BodYdiuvMp1T4-wiaNTKy3S-I-z7C57_FuHz61RBsKiw May 13 13:38:25.546535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:38:25.546535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:38:25.546535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:38:25.546535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:38:25.546535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:38:25.546535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:38:25.546535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: 6445798bd0f5475dba3878ea68e1eada May 13 13:38:25.546535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-TestVolumeBootPattern-1980468939 May 13 13:38:25.546535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:38:25.546535 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:38:25.549198 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6445798bd0f5475dba3878ea68e1eada", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6445798bd0f5475dba3878ea68e1eada"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6445798bd0f5475dba3878ea68e1eada"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6445798bd0f5475dba3878ea68e1eada"}]}] May 13 13:38:25.549198 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-TestVolumeBootPattern-1980468939 May 13 13:38:25.549198 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 6445798bd0f5475dba3878ea68e1eada May 13 13:38:25.549198 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-TestVolumeBootPattern-1980468939 May 13 13:38:25.549198 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-TestVolumeBootPattern-1980468939-project May 13 13:38:25.549198 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:38:25.549198 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:38:25.549198 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: 795a6f067c50494f99fea0b5afc82112 May 13 13:38:25.549198 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-TestVolumeBootPattern-1980468939-project May 13 13:38:25.549198 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: > May 13 13:38:25.549198 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Instance a5b3716e-b5e3-4b0c-ab47-049b80ccb815 could not be found. May 13 13:38:25.549198 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': 'a5b3716e-b5e3-4b0c-ab47-049b80ccb815'} May 13 13:38:25.550275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:38:25.550275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:38:25.550275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:38:25.550275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:38:25.550275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:38:25.550275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:38:25.550275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:38:25.550275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:38:25.550275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:38:25.550275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:38:25.550275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5b3716e-b5e3-4b0c-ab47-049b80ccb815 could not be found. May 13 13:38:25.550275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:38:25.550275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:38:25.550275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:38:25.550275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:38:25.550275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:38:25.550275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:38:25.550275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:38:25.550275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:38:25.550275 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:38:25.551965 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:38:25.551965 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:38:25.551965 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:38:25.551965 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:38:25.551965 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:38:25.551965 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:38:25.551965 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:38:25.551965 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5b3716e-b5e3-4b0c-ab47-049b80ccb815 could not be found. May 13 13:38:25.551965 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:38:25.551965 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:38:25.551965 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:38:25.551965 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:38:25.551965 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:38:25.551965 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:38:25.551965 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:38:25.551965 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:38:25.551965 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5b3716e-b5e3-4b0c-ab47-049b80ccb815 could not be found. May 13 13:38:25.551965 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:38:25.553416 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-af641d3c-dc71-4f83-8d13-ce5f4601255b tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Returning 404 to user: Instance a5b3716e-b5e3-4b0c-ab47-049b80ccb815 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:38:25.553416 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-af641d3c-dc71-4f83-8d13-ce5f4601255b tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815" status: 404 len: 111 microversion: 2.1 time: 0.029559 May 13 13:38:25.553416 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 584/1140] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:38:25 2022] GET /compute/v2.1/servers/a5b3716e-b5e3-4b0c-ab47-049b80ccb815 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:38:29.212592 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c5de3a27-61bb-4499-9812-7d5f74e22bd9 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:38:29.213071 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c5de3a27-61bb-4499-9812-7d5f74e22bd9 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: d79a77a4-9726-4d66-a733-568237a3b2fb] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:38:29.219771 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c5de3a27-61bb-4499-9812-7d5f74e22bd9 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:29.220960 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c5de3a27-61bb-4499-9812-7d5f74e22bd9 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:29.221439 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-a145f896-9cdd-4524-99d6-f934527581cf req-d43a2da6-f35a-4381-9f0c-99224268590b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d79a77a4-9726-4d66-a733-568237a3b2fb", "tag": "71dd5492-9e7a-4331-96ca-71e55d876b81"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:38:29.221951 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c5de3a27-61bb-4499-9812-7d5f74e22bd9 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:29.222148 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c5de3a27-61bb-4499-9812-7d5f74e22bd9 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:29.230460 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-a145f896-9cdd-4524-99d6-f934527581cf req-d43a2da6-f35a-4381-9f0c-99224268590b service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:29.230902 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-a145f896-9cdd-4524-99d6-f934527581cf req-d43a2da6-f35a-4381-9f0c-99224268590b service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:29.242892 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-a145f896-9cdd-4524-99d6-f934527581cf req-d43a2da6-f35a-4381-9f0c-99224268590b service nova] Creating event network-changed:71dd5492-9e7a-4331-96ca-71e55d876b81 for instance d79a77a4-9726-4d66-a733-568237a3b2fb on hv-cinder-84163 May 13 13:38:29.249399 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-a145f896-9cdd-4524-99d6-f934527581cf req-d43a2da6-f35a-4381-9f0c-99224268590b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032021 May 13 13:38:29.250315 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 585/1141] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:38:29.252032 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c5de3a27-61bb-4499-9812-7d5f74e22bd9 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: d79a77a4-9726-4d66-a733-568237a3b2fb] Going to try to terminate instance {{(pid=117720) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:38:29.540018 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c5de3a27-61bb-4499-9812-7d5f74e22bd9 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb" status: 204 len: 0 microversion: 2.1 time: 0.330438 May 13 13:38:29.540942 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 557/1142] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:38:29 2022] DELETE /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:38:29.550574 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-11f669f1-7159-45b3-9bab-975c54b573b3 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:38:29.551430 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-11f669f1-7159-45b3-9bab-975c54b573b3 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: d79a77a4-9726-4d66-a733-568237a3b2fb] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:38:29.557624 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-11f669f1-7159-45b3-9bab-975c54b573b3 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:29.558246 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-11f669f1-7159-45b3-9bab-975c54b573b3 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:29.559284 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-11f669f1-7159-45b3-9bab-975c54b573b3 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:29.559937 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-11f669f1-7159-45b3-9bab-975c54b573b3 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:29.706563 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-11f669f1-7159-45b3-9bab-975c54b573b3 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:38:29.714125 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-11f669f1-7159-45b3-9bab-975c54b573b3 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb" status: 200 len: 1579 microversion: 2.1 time: 0.168841 May 13 13:38:29.714725 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 586/1143] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:38:29 2022] GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb => generated 1579 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:38:30.733235 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c7fc4126-4b49-4a13-a91b-0e0164909c0c tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:38:30.733938 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c7fc4126-4b49-4a13-a91b-0e0164909c0c tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: d79a77a4-9726-4d66-a733-568237a3b2fb] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:38:30.740476 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c7fc4126-4b49-4a13-a91b-0e0164909c0c tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:30.740922 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c7fc4126-4b49-4a13-a91b-0e0164909c0c tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:30.741683 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c7fc4126-4b49-4a13-a91b-0e0164909c0c tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:30.742113 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c7fc4126-4b49-4a13-a91b-0e0164909c0c tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:30.874437 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c7fc4126-4b49-4a13-a91b-0e0164909c0c tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:38:30.882752 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c7fc4126-4b49-4a13-a91b-0e0164909c0c tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb" status: 200 len: 1579 microversion: 2.1 time: 0.153719 May 13 13:38:30.883319 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 558/1144] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:38:30 2022] GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:38:31.541655 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-0ba774a4-9eda-4581-a002-582cee73755b req-8688c939-7705-48cb-8229-d3c891a736b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79a77a4-9726-4d66-a733-568237a3b2fb", "name": "network-vif-deleted", "tag": "71dd5492-9e7a-4331-96ca-71e55d876b81"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:38:31.551293 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-0ba774a4-9eda-4581-a002-582cee73755b req-8688c939-7705-48cb-8229-d3c891a736b1 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:31.552594 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-0ba774a4-9eda-4581-a002-582cee73755b req-8688c939-7705-48cb-8229-d3c891a736b1 service nova] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:31.562639 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-0ba774a4-9eda-4581-a002-582cee73755b req-8688c939-7705-48cb-8229-d3c891a736b1 service nova] Creating event network-vif-deleted:71dd5492-9e7a-4331-96ca-71e55d876b81 for instance d79a77a4-9726-4d66-a733-568237a3b2fb on hv-cinder-84163 May 13 13:38:31.567887 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-0ba774a4-9eda-4581-a002-582cee73755b req-8688c939-7705-48cb-8229-d3c891a736b1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029945 May 13 13:38:31.568475 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 587/1145] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 13 13:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:38:31.900493 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f12b2bab-031f-402c-939d-627816638cba tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:38:31.901741 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f12b2bab-031f-402c-939d-627816638cba tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: d79a77a4-9726-4d66-a733-568237a3b2fb] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:38:31.908579 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f12b2bab-031f-402c-939d-627816638cba tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:31.909020 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f12b2bab-031f-402c-939d-627816638cba tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:31.909795 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f12b2bab-031f-402c-939d-627816638cba tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:31.910252 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f12b2bab-031f-402c-939d-627816638cba tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:31.979538 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f12b2bab-031f-402c-939d-627816638cba tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795a6f067c50494f99fea0b5afc82112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6445798bd0f5475dba3878ea68e1eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:38:31.988206 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f12b2bab-031f-402c-939d-627816638cba tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb" status: 200 len: 1226 microversion: 2.1 time: 0.091722 May 13 13:38:31.988780 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 559/1146] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:38:31 2022] GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:38:33.006391 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d04f3e93-fc72-4634-bd11-82e256b5fb28 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:38:33.007078 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d04f3e93-fc72-4634-bd11-82e256b5fb28 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: d79a77a4-9726-4d66-a733-568237a3b2fb] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:38:33.013222 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d04f3e93-fc72-4634-bd11-82e256b5fb28 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:33.013666 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d04f3e93-fc72-4634-bd11-82e256b5fb28 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:33.014457 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d04f3e93-fc72-4634-bd11-82e256b5fb28 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:33.014894 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d04f3e93-fc72-4634-bd11-82e256b5fb28 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:33.028298 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-d04f3e93-fc72-4634-bd11-82e256b5fb28 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] HTTP exception thrown: Instance d79a77a4-9726-4d66-a733-568237a3b2fb could not be found. May 13 13:38:33.029901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d04f3e93-fc72-4634-bd11-82e256b5fb28 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Request method failure captured: May 13 13:38:33.029901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb HTTP/1.1 May 13 13:38:33.029901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:38:33.029901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:38:33.029901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:38:33.029901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:38:33.029901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:38:33.029901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:38:33.029901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:38:33.029901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:38:33.029901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABifl215GzSWxfcaNARM81XopICQ8JbCpgFT9dyr55BlJj4fgbgJg9RUpYucZ-dA24qKkawAZqyPR7h9k9-n6n440q09_B0VMX3x2TMFW8FvvlUh9ZehRYLjn-IpsrST-Ny3D5BodYdiuvMp1T4-wiaNTKy3S-I-z7C57_FuHz61RBsKiw May 13 13:38:33.029901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:38:33.029901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:38:33.029901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:38:33.029901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:38:33.029901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:38:33.029901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:38:33.029901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: 6445798bd0f5475dba3878ea68e1eada May 13 13:38:33.029901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-TestVolumeBootPattern-1980468939 May 13 13:38:33.029901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:38:33.029901 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:38:33.031588 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6445798bd0f5475dba3878ea68e1eada", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6445798bd0f5475dba3878ea68e1eada"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6445798bd0f5475dba3878ea68e1eada"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6445798bd0f5475dba3878ea68e1eada"}]}] May 13 13:38:33.031588 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-TestVolumeBootPattern-1980468939 May 13 13:38:33.031588 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 6445798bd0f5475dba3878ea68e1eada May 13 13:38:33.031588 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-TestVolumeBootPattern-1980468939 May 13 13:38:33.031588 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-TestVolumeBootPattern-1980468939-project May 13 13:38:33.031588 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:38:33.031588 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:38:33.031588 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: 795a6f067c50494f99fea0b5afc82112 May 13 13:38:33.031588 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-TestVolumeBootPattern-1980468939-project May 13 13:38:33.031588 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: > May 13 13:38:33.031588 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Instance d79a77a4-9726-4d66-a733-568237a3b2fb could not be found. May 13 13:38:33.031588 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': 'd79a77a4-9726-4d66-a733-568237a3b2fb'} May 13 13:38:33.032525 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:38:33.032525 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:38:33.032525 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:38:33.032525 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:38:33.032525 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:38:33.032525 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:38:33.032525 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:38:33.032525 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:38:33.032525 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:38:33.032525 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:38:33.032525 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d79a77a4-9726-4d66-a733-568237a3b2fb could not be found. May 13 13:38:33.032525 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:38:33.032525 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:38:33.032525 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:38:33.032525 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:38:33.032525 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:38:33.032525 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:38:33.032525 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:38:33.032525 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:38:33.032525 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:38:33.034104 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:38:33.034104 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:38:33.034104 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:38:33.034104 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:38:33.034104 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:38:33.034104 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:38:33.034104 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:38:33.034104 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d79a77a4-9726-4d66-a733-568237a3b2fb could not be found. May 13 13:38:33.034104 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:38:33.034104 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:38:33.034104 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:38:33.034104 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:38:33.034104 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:38:33.034104 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:38:33.034104 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:38:33.034104 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:38:33.034104 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d79a77a4-9726-4d66-a733-568237a3b2fb could not be found. May 13 13:38:33.034104 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:38:33.035525 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d04f3e93-fc72-4634-bd11-82e256b5fb28 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Returning 404 to user: Instance d79a77a4-9726-4d66-a733-568237a3b2fb could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:38:33.035525 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d04f3e93-fc72-4634-bd11-82e256b5fb28 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb" status: 404 len: 111 microversion: 2.1 time: 0.030216 May 13 13:38:33.035525 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 588/1147] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:38:32 2022] GET /compute/v2.1/servers/d79a77a4-9726-4d66-a733-568237a3b2fb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:38:33.542036 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-317783f2-becd-4fab-bed1-70712a2c0cc6 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:38:33.542599 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-317783f2-becd-4fab-bed1-70712a2c0cc6 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:38:33.549511 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-317783f2-becd-4fab-bed1-70712a2c0cc6 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:33.549951 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-317783f2-becd-4fab-bed1-70712a2c0cc6 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:33.550738 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-317783f2-becd-4fab-bed1-70712a2c0cc6 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:33.551170 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-317783f2-becd-4fab-bed1-70712a2c0cc6 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:33.565618 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-317783f2-becd-4fab-bed1-70712a2c0cc6 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] HTTP exception thrown: Instance a4c37c70-bc64-4dc6-92eb-41a9df5a319f could not be found. May 13 13:38:33.567312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-317783f2-becd-4fab-bed1-70712a2c0cc6 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Request method failure captured: May 13 13:38:33.567312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: request: DELETE /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f HTTP/1.1 May 13 13:38:33.567312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept: application/json May 13 13:38:33.567312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity May 13 13:38:33.567312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Connection: close May 13 13:38:33.567312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Length: 0 May 13 13:38:33.567312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Content-Type: application/json May 13 13:38:33.567312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Host: 10.222.0.13 May 13 13:38:33.567312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None May 13 13:38:33.567312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 May 13 13:38:33.567312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABifl215GzSWxfcaNARM81XopICQ8JbCpgFT9dyr55BlJj4fgbgJg9RUpYucZ-dA24qKkawAZqyPR7h9k9-n6n440q09_B0VMX3x2TMFW8FvvlUh9ZehRYLjn-IpsrST-Ny3D5BodYdiuvMp1T4-wiaNTKy3S-I-z7C57_FuHz61RBsKiw May 13 13:38:33.567312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Id: None May 13 13:38:33.567312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Domain-Name: None May 13 13:38:33.567312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed May 13 13:38:33.567312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True May 13 13:38:33.567312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default May 13 13:38:33.567312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default May 13 13:38:33.567312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Id: 6445798bd0f5475dba3878ea68e1eada May 13 13:38:33.567312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-TestVolumeBootPattern-1980468939 May 13 13:38:33.567312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Role: member,reader May 13 13:38:33.567312 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Roles: member,reader May 13 13:38:33.568985 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6445798bd0f5475dba3878ea68e1eada", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6445798bd0f5475dba3878ea68e1eada"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6445798bd0f5475dba3878ea68e1eada"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6445798bd0f5475dba3878ea68e1eada"}]}] May 13 13:38:33.568985 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-TestVolumeBootPattern-1980468939 May 13 13:38:33.568985 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 6445798bd0f5475dba3878ea68e1eada May 13 13:38:33.568985 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-TestVolumeBootPattern-1980468939 May 13 13:38:33.568985 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User: tempest-TestVolumeBootPattern-1980468939-project May 13 13:38:33.568985 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default May 13 13:38:33.568985 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default May 13 13:38:33.568985 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Id: 795a6f067c50494f99fea0b5afc82112 May 13 13:38:33.568985 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-TestVolumeBootPattern-1980468939-project May 13 13:38:33.568985 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: method: > May 13 13:38:33.568985 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: exception: Instance a4c37c70-bc64-4dc6-92eb-41a9df5a319f could not be found. May 13 13:38:33.568985 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: action_args: {'id': 'a4c37c70-bc64-4dc6-92eb-41a9df5a319f'} May 13 13:38:33.569993 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:38:33.569993 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:38:33.569993 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:38:33.569993 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:38:33.569993 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:38:33.569993 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:38:33.569993 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:38:33.569993 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:38:33.569993 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:38:33.569993 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:38:33.569993 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4c37c70-bc64-4dc6-92eb-41a9df5a319f could not be found. May 13 13:38:33.569993 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:38:33.569993 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:38:33.569993 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:38:33.569993 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:38:33.569993 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:38:33.569993 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:38:33.569993 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:38:33.569993 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:38:33.569993 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:38:33.571649 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:38:33.571649 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:38:33.571649 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:38:33.571649 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:38:33.571649 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:38:33.571649 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:38:33.571649 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:38:33.571649 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:38:33.571649 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:38:33.571649 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4c37c70-bc64-4dc6-92eb-41a9df5a319f could not be found. May 13 13:38:33.571649 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:38:33.571649 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:38:33.571649 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:38:33.571649 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:38:33.571649 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:38:33.571649 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:38:33.571649 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:38:33.571649 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:38:33.571649 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4c37c70-bc64-4dc6-92eb-41a9df5a319f could not be found. May 13 13:38:33.571649 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi May 13 13:38:33.573278 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-317783f2-becd-4fab-bed1-70712a2c0cc6 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Returning 404 to user: Instance a4c37c70-bc64-4dc6-92eb-41a9df5a319f could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:38:33.573278 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-317783f2-becd-4fab-bed1-70712a2c0cc6 tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f" status: 404 len: 111 microversion: 2.1 time: 0.030942 May 13 13:38:33.573278 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 560/1148] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 13 13:38:33 2022] DELETE /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:38:33.577635 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7d15410a-2872-445e-b490-363e4f05645d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:38:33.578276 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7d15410a-2872-445e-b490-363e4f05645d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] [instance: a4c37c70-bc64-4dc6-92eb-41a9df5a319f] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:38:33.584727 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7d15410a-2872-445e-b490-363e4f05645d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:33.585167 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7d15410a-2872-445e-b490-363e4f05645d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:33.585936 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7d15410a-2872-445e-b490-363e4f05645d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:38:33.586403 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7d15410a-2872-445e-b490-363e4f05645d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Lock "ed747a63-75f5-43f4-a721-9b3138eb67b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:38:33.599519 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-7d15410a-2872-445e-b490-363e4f05645d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] HTTP exception thrown: Instance a4c37c70-bc64-4dc6-92eb-41a9df5a319f could not be found. May 13 13:38:33.601277 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7d15410a-2872-445e-b490-363e4f05645d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Request method failure captured: May 13 13:38:33.601277 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f HTTP/1.1 May 13 13:38:33.601277 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept: application/json May 13 13:38:33.601277 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity May 13 13:38:33.601277 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Connection: close May 13 13:38:33.601277 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Length: 0 May 13 13:38:33.601277 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Content-Type: application/json May 13 13:38:33.601277 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Host: 10.222.0.13 May 13 13:38:33.601277 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None May 13 13:38:33.601277 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 May 13 13:38:33.601277 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABifl215GzSWxfcaNARM81XopICQ8JbCpgFT9dyr55BlJj4fgbgJg9RUpYucZ-dA24qKkawAZqyPR7h9k9-n6n440q09_B0VMX3x2TMFW8FvvlUh9ZehRYLjn-IpsrST-Ny3D5BodYdiuvMp1T4-wiaNTKy3S-I-z7C57_FuHz61RBsKiw May 13 13:38:33.601277 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Id: None May 13 13:38:33.601277 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Domain-Name: None May 13 13:38:33.601277 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed May 13 13:38:33.601277 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True May 13 13:38:33.601277 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default May 13 13:38:33.601277 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default May 13 13:38:33.601277 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Id: 6445798bd0f5475dba3878ea68e1eada May 13 13:38:33.601277 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-TestVolumeBootPattern-1980468939 May 13 13:38:33.601277 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Role: member,reader May 13 13:38:33.601277 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Roles: member,reader May 13 13:38:33.602989 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6445798bd0f5475dba3878ea68e1eada", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6445798bd0f5475dba3878ea68e1eada"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6445798bd0f5475dba3878ea68e1eada"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6445798bd0f5475dba3878ea68e1eada"}]}] May 13 13:38:33.602989 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-TestVolumeBootPattern-1980468939 May 13 13:38:33.602989 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 6445798bd0f5475dba3878ea68e1eada May 13 13:38:33.602989 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-TestVolumeBootPattern-1980468939 May 13 13:38:33.602989 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User: tempest-TestVolumeBootPattern-1980468939-project May 13 13:38:33.602989 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default May 13 13:38:33.602989 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default May 13 13:38:33.602989 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Id: 795a6f067c50494f99fea0b5afc82112 May 13 13:38:33.602989 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-TestVolumeBootPattern-1980468939-project May 13 13:38:33.602989 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: method: > May 13 13:38:33.602989 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: exception: Instance a4c37c70-bc64-4dc6-92eb-41a9df5a319f could not be found. May 13 13:38:33.602989 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: action_args: {'id': 'a4c37c70-bc64-4dc6-92eb-41a9df5a319f'} May 13 13:38:33.604300 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:38:33.604300 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:38:33.604300 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:38:33.604300 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:38:33.604300 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:38:33.604300 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:38:33.604300 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:38:33.604300 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:38:33.604300 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:38:33.604300 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:38:33.604300 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4c37c70-bc64-4dc6-92eb-41a9df5a319f could not be found. May 13 13:38:33.604300 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:38:33.604300 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:38:33.604300 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:38:33.604300 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:38:33.604300 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:38:33.604300 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:38:33.604300 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:38:33.604300 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:38:33.604300 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:38:33.605814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:38:33.605814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:38:33.605814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:38:33.605814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:38:33.605814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:38:33.605814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:38:33.605814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:38:33.605814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4c37c70-bc64-4dc6-92eb-41a9df5a319f could not be found. May 13 13:38:33.605814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:38:33.605814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:38:33.605814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:38:33.605814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:38:33.605814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:38:33.605814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:38:33.605814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:38:33.605814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:38:33.605814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4c37c70-bc64-4dc6-92eb-41a9df5a319f could not be found. May 13 13:38:33.605814 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi May 13 13:38:33.607354 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7d15410a-2872-445e-b490-363e4f05645d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Returning 404 to user: Instance a4c37c70-bc64-4dc6-92eb-41a9df5a319f could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:38:33.607354 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7d15410a-2872-445e-b490-363e4f05645d tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f" status: 404 len: 111 microversion: 2.1 time: 0.028913 May 13 13:38:33.607354 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 589/1149] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 13 13:38:33 2022] GET /compute/v2.1/servers/a4c37c70-bc64-4dc6-92eb-41a9df5a319f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:38:35.075568 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6ffb6904-3682-44c4-b5c6-dfeaf743477f tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] Calling method '.version_select at 0x7fb0842a1550>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:38:35.151419 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6ffb6904-3682-44c4-b5c6-dfeaf743477f tempest-TestVolumeBootPattern-1980468939 tempest-TestVolumeBootPattern-1980468939-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1117102184" status: 202 len: 0 microversion: 2.1 time: 0.079787 May 13 13:38:35.152000 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 561/1150] 10.222.0.13 () {58 vars in 1262 bytes} [Fri May 13 13:38:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1117102184 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:39:23.351542 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:39:23.352110 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Fri May 13 13:39:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:39:44.108277 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:39:44.108882 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Fri May 13 13:39:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:39:52.855399 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:39:52.856008 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Fri May 13 13:39:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:41:32.866982 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:41:32.867604 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Fri May 13 13:41:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:41:46.038444 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:41:46.039146 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Fri May 13 13:41:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:41:47.211753 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:41:47.212231 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Fri May 13 13:41:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:42:43.360927 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:42:43.361673 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Fri May 13 13:42:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:43:04.116485 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:43:04.117149 dv-cinder-841632-1-iscsi devstack@n-api.service[117720]: Fri May 13 13:43:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:43:12.864237 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:43:12.864812 dv-cinder-841632-1-iscsi devstack@n-api.service[117721]: Fri May 13 13:43:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!